Search

We examine the capability of Multimodal Large Language Models (MLLMs) to tackle diverse domains that extend beyond the traditional language and vision tasks these models are typically trained on. Specifically, our focus lies in areas such as Embodied AI, Games, UI Control, and Planning. To this end, we introduce a process of adapting an MLLM to a Generalist Embodied Agent (GEA). GEA is a single unified model capable of grounding itself across these varied domains through a multi-embodiment action tokenizer. GEA is trained with supervised learning on a large dataset of embodied experiences and with online RL in interactive simulators. We explore the data and algorithmic choices necessary to develop such a model. Our findings reveal the importance of training with cross-domain data and online RL for building generalist agents. The final GEA model achieves strong generalization performance to unseen tasks across diverse benchmarks compared to other generalist models and benchmark-specific approaches.

Ranking is a fundamental and popular problem in search. However, existing ranking algorithms usually restrict the granularity of ranking to full passages or require a specific dense index for each desired level of granularity. Such lack of flexibility in granularity negatively affects many applications that can benefit from more granular ranking, such as sentence-level ranking for open-domain question-answering, or proposition-level ranking for attribution. In this work, we introduce the idea of any-granularity ranking, which leverages multi-vector embeddings to rank at varying levels of granularity while maintaining encoding at a single (coarser) level of granularity. We propose a multi-granular contrastive loss for training multi-vector approaches, and validate its utility with both sentences and propositions as ranking units. Finally, we demonstrate the application of proposition-level ranking to post-hoc citation addition in retrieval-augmented generation, surpassing the performance of prompt-driven citation generation.

Entity disambiguation (ED), which links the mentions of ambiguous entities to their referent entities in a knowledge base, serves as a core component in entity linking (EL). Existing generative approaches demonstrate improved accuracy compared to classification approaches under the standardized ZELDA benchmark. Nevertheless, generative approaches suffer from the need for large-scale pre-training and inefficient generation. Most importantly, entity descriptions, which could contain crucial information to distinguish similar entities from each other, are often overlooked. We propose an encoder-decoder model to disambiguate entities with more detailed entity descriptions. Given text and candidate entities, the encoder learns interactions between the text and each candidate entity, producing representations for each entity candidate. The decoder then fuses the representations of entity candidates together and selects the correct entity. Our experiments, conducted on various entity disambiguation benchmarks, demonstrate the strong and robust performance of this model, particularly +1.5% in the ZELDA benchmark compared with GENRE. Furthermore, we integrate this approach into the retrieval/reader framework and observe +1.5% improvements in end-to-end entity linking in the GERBIL benchmark compared with EntQA., Comment: Accepted at NAACL'24 main

We present the discovery and characterization of two warm mini-Neptunes transiting the K3V star TOI-815 in a K-M binary system. Analysis of the spectra and rotation period reveal it to be a young star with an age of $200^{+400}_{-200}$Myr. TOI-815b has a 11.2-day period and a radius of 2.94$\pm$0.05$\it{R_{\rm\mathrm{\oplus}}}$ with transits observed by TESS, CHEOPS, ASTEP, and LCOGT. The outer planet, TOI-815c, has a radius of 2.62$\pm$0.10$\it{R_{\rm\mathrm{\oplus}}}$, based on observations of three non-consecutive transits with TESS, while targeted CHEOPS photometry and radial velocity follow-up with ESPRESSO were required to confirm the 35-day period. ESPRESSO confirmed the planetary nature of both planets and measured masses of 7.6$\pm$1.5 $\it{M_{\rm \mathrm{\oplus}}}$ ($\rho_\mathrm{P}$=1.64$^{+0.33}_{-0.31}$gcm$^{-3}$) and 23.5$\pm$2.4$\it{M_{\rm\mathrm{\oplus}}}$ ($\rho_\mathrm{P}$=7.2$^{+1.1}_{-1.0}$gcm$^{-3}$) respectively. Thus, the planets have very different masses, unlike the usual similarity of masses in compact multi-planet systems. Moreover, our statistical analysis of mini-Neptunes orbiting FGK stars suggests that weakly irradiated planets tend to have higher bulk densities compared to those suffering strong irradiation. This could be ascribed to their cooler atmospheres, which are more compressed and denser. Internal structure modeling of TOI-815b suggests it likely has a H-He atmosphere constituting a few percent of the total planet mass, or higher if the planet is assumed to have no water. In contrast, the measured mass and radius of TOI-815c can be explained without invoking any atmosphere, challenging planetary formation theories. Finally, we infer from our measurements that the star is viewed close to pole-on, which implies a spin-orbit misalignment at the 3$\sigma$ level., Comment: 24 pages, 27 figures, 6 tables

While the sample of confirmed exoplanets continues to increase, the population of transiting exoplanets around early-type stars is still limited. These planets allow us to investigate the planet properties and formation pathways over a wide range of stellar masses and study the impact of high irradiation on hot Jupiters orbiting such stars. We report the discovery of TOI-615b, TOI-622b, and TOI-2641b, three Saturn-mass planets transiting main sequence, F-type stars. The planets were identified by the Transiting Exoplanet Survey Satellite (TESS) and confirmed with complementary ground-based and radial velocity observations. TOI-615b is a highly irradiated ($\sim$1277 $F_{\oplus}$) and bloated Saturn-mass planet (1.69$^{+0.05}_{-0.06}$$R_{Jup}$ and 0.43$^{+0.09}_{-0.08}$$M_{Jup}$) in a 4.66 day orbit transiting a 6850 K star. TOI-622b has a radius of 0.82$^{+0.03}_{-0.03}$$R_{Jup}$ and a mass of 0.30$^{+0.07}_{-0.08}$~$M_{Jup}$ in a 6.40 day orbit. Despite its high insolation flux ($\sim$600 $F_{\oplus}$), TOI-622b does not show any evidence of radius inflation. TOI-2641b is a 0.39$^{+0.02}_{-0.04}$$M_{Jup}$ planet in a 4.88 day orbit with a grazing transit (b = 1.04$^{+0.05}_{-0.06 }$) that results in a poorly constrained radius of 1.61$^{+0.46}_{-0.64}$$R_{Jup}$. Additionally, TOI-615b is considered attractive for atmospheric studies via transmission spectroscopy with ground-based spectrographs and $\textit{JWST}$. Future atmospheric and spin-orbit alignment observations are essential since they can provide information on the atmospheric composition, formation and migration of exoplanets across various stellar types., Comment: 16 pages, 17 figures, submitted to A&A

KELT-11b is an inflated sub-Saturn with a hot atmosphere and that orbits a bright evolved subgiant star, making it a prime choice for atmospheric characterization, but that transits its host star for more than seven hours. We observed this system in series of three consecutive nights with the HARPS spectrograph and report on the analysis of the transmission spectrum obtained from this dataset. Our results highlight the potential for independent observations of a long-transiting planet over consecutive nights. Our study reveals a sodium excess absorption of $0.28 \pm 0.05 \%$ and $0.50 \pm 0.06 \%$ in the Na D1 and D2 lines, respectively. This corresponds to 1.44 and 1.69 times the white-light planet radius in the line cores. Wind pattern modeling tends to prefer day-to-night side winds with no vertical winds, which is surprising considering the planet bloatedness. The modeling of the Rossiter-Mclaughlin effect yields a significantly misaligned orbit, with a projected spin-orbit angle of ${\lambda} = -77.86^{+2.36}_{-2.26}{}^\circ$. The characteristics of KELT-11 b, notably its extreme scale height and long transit, make it an ideal and unique target for next-generation telescopes. Our results as well as recent findings from HST, TESS, and CHEOPS observations could make KELT-11 b a benchmark exoplanet in atmospheric characterization., Comment: 19 pages, 18 figures, 8 tables. Accepted for publication in Astronomy & Astrophysics

We investigate the effect of the Biermann battery during the Epoch of Reionization (EoR) using cosmological Adaptive Mesh Refinement simulations within the framework of the SPHINX project. We develop a novel numerical technique to solve for the Biermann battery term in the Constrained Transport method, preserving both the zero divergence of the magnetic field and the absence of Biermann battery for isothermal flows. The structure-preserving nature of our numerical method turns out to be very important to minimise numerical errors during validation tests of the propagation of a Str\"omgren sphere and of a Sedov blast wave. We then use this new method to model the evolution of a 2.5 and 5 co-moving Mpc cosmological box with a state-of-the-art galaxy formation model within the RAMSES code. Contrary to previous findings, we show that three different Biermann battery channels emerge: the first one is associated with linear perturbations before the EoR, the second one is the classical Biermann battery associated with reionization fronts during the EoR, and the third one is associated with strong, supernova-driven outflows. While the two former channels generate spontaneously volume-filling magnetic fields with a strength on the order or below $10^{-20}$ G, the latter, owing to the higher plasma temperature and a marginally-resolved turbulent dynamo, reaches a field strength as high as $10^{-18}$ G in the intergalactic medium around massive haloes., Comment: 14 pages, 18 figures, accepted in MNRAS

We present the first results from SPHINX-MHD, a suite of cosmological radiation-magnetohydrodynamics simulations designed to study the impact of primordial magnetic fields (PMFs) on galaxy formation and the evolution of the intergalactic medium during the epoch of reionization. The simulations are among the first to employ multi-frequency, on-the-fly radiation transfer and constrained transport ideal MHD in a cosmological context to simultaneously model the inhomogeneous process of reionization as well as the growth of PMFs. We run a series of $(5\,\text{cMpc})^3$ cosmological volumes, varying both the strength of the seed magnetic field ($B_0$) and its spectral index ($n_B$). We find that PMFs that have $n_B > -0.562\log_{10}\left(\frac{B_0}{1{\rm n}G}\right) - 3.35$ produce electron optical depths ($\tau_e$) that are inconsistent with CMB constraints due to the unrealistically early collapse of low-mass dwarf galaxies. For $n_B\geq-2.9$, our constraints are considerably tighter than the $\sim{\rm n}G$ constraints from Planck. PMFs that do not satisfy our constraints have little impact on the reionization history or the shape of the UV luminosity function. Likewise, detecting changes in the Lya forest due to PMFs will be challenging because photoionisation and photoheating efficiently smooth the density field. However, we find that the first absorption feature in the global 21cm signal is a sensitive indicator of the properties of the PMFs, even for those that satisfy our $\tau_e$ constraint. Furthermore, strong PMFs can marginally increase the escape of LyC photons by up to 25\% and shrink the effective radii of galaxies by $\sim44\%$ which could increase the completeness fraction of galaxy surveys. Finally, our simulations show that surveys with a magnitude limit of ${\rm M_{UV,1500}=-13}$ can probe the sources that provide the majority of photons for reionization out to $z=12$., Comment: 29 pages, 27 figures, accepted MNRAS

Here, we report the case of recurrent swelling and pain in the proximal interphalangeal joint of the left ring finger, which was later diagnosed as a localized tenosynovial giant cell tumor in a young adult female. The first presentation was at the same anatomical site four years prior. Examination at presentation showed a firm skin-colored nodule in the volar aspect of the left ring finger. The swelling was seen to be partly attached to underlying structures and was non-tender. After a careful physical examination and plain radiograph imaging of the hand, the two differential diagnoses considered were tenosynovial giant cell tumor and ganglion cyst. A surgical excision was performed, and histopathologic evaluation showed features consistent with a tenosynovial giant cell tumor, localized type. The resection margins were clear of tumor. The patient had no intraoperative or postoperative complications. Postoperative physiotherapy was recommended. No recurrence was seen after postoperative surgical follow-up for one year. This report highlights the importance of histopathologic evaluation and confirmation of clear surgical margins in the management of tenosynovial giant cell tumors. In recurrent cases, surgical re-excision with clear margins provides good clinical outcomes. Before surgical excision, patients should be informed about the biologic nature of the lesion and the high risk of recurrence. The management modalities to prevent recurrence and the need for long-term follow-up should also be discussed with the patient., Competing Interests: The authors have declared that no competing interests exist., (Copyright © 2024, Awosusi et al.)