Search

Using early data from the Dark Energy Spectroscopic Instrument (DESI) survey, we search for AGN signatures in 410,757 line-emitting galaxies. By employing the BPT emission-line ratio diagnostic diagram, we identify AGN in 75,928/296,261 ($\approx$25.6%) high-mass ($\log (M_{\star}/\rm M_{\odot}) >$ 9.5) and 2,444/114,496 ($\approx$2.1%) dwarf ($\log (M_{\star}/\rm M_{\odot}) \leq$ 9.5) galaxies. Of these AGN candidates, 4,181 sources exhibit a broad H$\alpha$ component, allowing us to estimate their BH masses via virial techniques. This study more than triples the census of dwarf AGN as well as that of intermediate-mass black hole (IMBH; $M_{\rm BH} \le 10^6~\rm M_{\odot}$) candidates, spanning a broad discovery space in stellar mass (7 $< \log (M_{\star}/\rm M_{\odot}) <$ 12) and redshift (0.001 $< \rm z <$ 0.45). The observed AGN fraction in dwarf galaxies ($\approx$2.1%) is nearly four times higher than prior estimates, primarily due to DESI's smaller fiber size, which enables the detection of lower luminosity dwarf AGN candidates. We also extend the $M_{\rm BH}$ - $M_{\star}$ scaling relation down to $\log (M_{\star}/\rm M_{\odot}) \approx$ 8.5 and $\log (M_{\rm BH}/M_{\odot}) \approx$ 4.4, with our results aligning well with previous low-redshift studies. The large statistical sample of dwarf AGN candidates from current and future DESI releases will be invaluable for enhancing our understanding of galaxy evolution at the low-mass end of the galaxy mass function., Comment: 35 pages, 22 figures, Submitted to AAS Journals, Comments are welcome

In an era increasingly dominated by digital platforms, the spread of misinformation poses a significant challenge, highlighting the need for solutions capable of assessing information veracity. Our research contributes to the field of Explainable Artificial Antelligence (XAI) by developing transformer-based fact-checking models that contextualise and justify their decisions by generating human-accessible explanations. Importantly, we also develop models for automatic evaluation of explanations for fact-checking verdicts across different dimensions such as \texttt{(self)-contradiction}, \texttt{hallucination}, \texttt{convincingness} and \texttt{overall quality}. By introducing human-centred evaluation methods and developing specialised datasets, we emphasise the need for aligning Artificial Intelligence (AI)-generated explanations with human judgements. This approach not only advances theoretical knowledge in XAI but also holds practical implications by enhancing the transparency, reliability and users' trust in AI-driven fact-checking systems. Furthermore, the development of our metric learning models is a first step towards potentially increasing efficiency and reducing reliance on extensive manual assessment. Based on experimental results, our best performing generative model \textsc{ROUGE-1} score of 47.77, demonstrating superior performance in generating fact-checking explanations, particularly when provided with high-quality evidence. Additionally, the best performing metric learning model showed a moderately strong correlation with human judgements on objective dimensions such as \texttt{(self)-contradiction and \texttt{hallucination}, achieving a Matthews Correlation Coefficient (MCC) of around 0.7.}, Comment: Forthcoming in Engineering Applications of Artificial Intelligence

We present X-ray spectroscopy of the SU UMa-type dwarf nova (DN) Z Cha using the EPIC and RGS instruments onboard the XMM-Newton Observatory. The quiescent system can be modeled by collisional equilibrium or nonequilibrium plasma models, yielding a kT of 8.2-13.0 keV at a luminosity of (5.0-6.0)$\times$10$^{30}$ erg/s. The spectra yield better reduced $\chi^{2}$ using partial covering absorbers of cold and photoionized nature. The ionized absorber has an equivalent N$_H$=(3.4-5.9)$\times$10$^{22}$ cm$^{-2}$ and a log($\xi$)=3.5-3.7 with (50-60)% covering fraction when VNEI model (XSPEC) is used. The line diagnosis in quiescence shows no resonance lines with only detected forbidden lines of Ne, Mg, Si. The H-like C, O, Ne, and Mg are detected. The strongest line is O VIII with (2.7-4.6)$\times$10$^{-14}$ erg/s/cm$^2$. The quiescent X-ray emitting plasma is not collisional and not in ionization equilibrium which is consistent with hot ADAF-like accretion flows. The line diagnosis in outburst shows He-like O, and Ne with intercombination lines being the strongest along with weaker resonance lines. This indicates the plasma is more collisional and denser, but yet not in a collisional equilibrium, revealing ionization timescales of (0.97-1.4)$\times$10$^{11}$ s cm$^{-3}$. The R-ratios in outburst yield electron densities of (7-90)$\times$10$^{11}$ cm$^{-3}$ and the G-ratios yield electron temperatures of (2-3)$\times$10$^{6}$ K. The outburst luminosity is (1.4-2.5)$\times$10$^{30}$ erg/s. The flow is inhomogeneous in density. All detected lines are narrow with widths limited by the resolution of RGS yielding Keplerian rotational velocities $<$1000 km/s. This is too low for boundary layers, consistent with the nature of ADAF-like hot flows., Comment: 27 Pages, 8 Figures, and 5 Tables, accepted to be published in the Astrophysical Journal, in press

Large Language Models (LLMs) have demonstrated remarkable performance across various domains, including healthcare. However, their ability to effectively represent structured non-textual data, such as the alphanumeric medical codes used in records like ICD-10 or SNOMED-CT, is limited and has been particularly exposed in recent research. This paper examines the challenges LLMs face in processing medical codes due to the shortcomings of current tokenization methods. As a result, we introduce the UniStruct architecture to design a multimodal medical foundation model of unstructured text and structured data, which addresses these challenges by adapting subword tokenization techniques specifically for the structured medical codes. Our approach is validated through model pre-training on both an extensive internal medical database and a public repository of structured medical records. Trained on over 1 billion tokens on the internal medical database, the proposed model achieves up to a 23% improvement in evaluation metrics, with around 2% gain attributed to our proposed tokenization. Additionally, when evaluated on the EHRSHOT public benchmark with a 1/1000 fraction of the pre-training data, the UniStruct model improves performance on over 42% of the downstream tasks. Our approach not only enhances the representation and generalization capabilities of patient-centric models but also bridges a critical gap in representation learning models' ability to handle complex structured medical data, alongside unstructured text., Comment: NeurIPS 2024 Workshop on Unifying Representations in Neural Models (UniReps 2024)

We measure the growth of cosmic density fluctuations on large scales and across the redshift range $0.3

The Large Magellanic Cloud (LMC) is a Milky Way (MW) satellite that is massive enough to gravitationally attract the MW disc and inner halo, causing significant motion of the inner MW with respect to the outer halo. In this work, we probe this interaction by constructing a sample of 9,866 blue horizontal branch (BHB) stars with radial velocities from the DESI spectroscopic survey out to 120 kpc from the Galactic centre. This is the largest spectroscopic set of BHB stars in the literature to date, and it contains four times more stars with Galactocentric distances beyond 50 kpc than previous BHB catalogues. Using the DESI BHB sample combined with SDSS BHBs, we measure the bulk radial velocity of stars in the outer halo and observe that the velocity in the Southern Galactic hemisphere is different by 3.7$\sigma$ from the North. Modelling the projected velocity field shows that its dipole component is directed at a point 22 degrees away from the LMC along its orbit, which we interpret as the travel direction of the inner MW. The velocity field includes a monopole term that is -24 km/s, which we refer to as compression velocity. This velocity is significantly larger than predicted by the current models of the MW and LMC interaction. This work uses DESI data from its first two years of observations, but we expect that with upcoming DESI data releases, the sample of BHB stars will increase and our ability to measure the MW-LMC interaction will improve significantly., Comment: 22 pages, 19 figures. Submitted to MNRAS

In this paper, we investigate the possibility of selecting high-redshift Lyman-Break Galaxies (LBG) using current and future broadband wide photometric surveys, such as UNIONS or the Vera C. Rubin LSST, using a Random Forest algorithm. This work is conducted in the context of future large-scale structure spectroscopic surveys like DESI-II, the next phase of the Dark Energy Spectroscopic Instrument (DESI), which will start around 2029. We use deep imaging data from HSC and CLAUDS on the COSMOS and XMM-LSS fields. To predict the selection performance of LBGs with image quality similar to UNIONS, we degrade the $u, g, r, i$ and $z$ bands to UNIONS depth. The Random Forest algorithm is trained with the $u,g,r,i$ and $z$ bands to classify LBGs in the $2.5 < z < 3.5$ range. We find that fixing a target density budget of $1,100$ deg$^{-2}$, the Random Forest approach gives a density of $z>2$ targets of $873$ deg$^{-2}$, and a density of $493$ deg$^{-2}$ of confirmed LBGs after spectroscopic confirmation with DESI. This UNIONS-like selection was tested in a dedicated spectroscopic observation campaign of 1,000 targets with DESI on the COSMOS field, providing a safe spectroscopic sample with a mean redshift of 3. This sample is used to derive forecasts for DESI-II, assuming a sky coverage of 5,000 deg$^2$. We predict uncertainties on Alcock-Paczynski parameters $\alpha_\perp$ and $\alpha_{\parallel}$ to be 0.7$\%$ and 1$\%$ for $2.6

Aims. We present an extensive catalog of the physical properties of more than a million galaxies within the Dark Energy Spectroscopic Instrument (DESI), one of the largest spectroscopic surveys to date. Spanning over a full variety of target types, including emission line galaxies and luminous red galaxies as well as quasars, our survey encompasses an unprecedented range of spectroscopic redshifts, stretching from 0 to 6. Methods. The physical properties, such as stellar masses and star formation rates, are derived via the CIGALE spectral energy distribution (SED) fitting code accounting for the contribution coming from active galactic nuclei (AGN). Based on the modeling of the optical-mid-infrared (grz complemented by WISE photometry) SEDs, we study galaxy properties with respect to their location on the main sequence. Results. We revise the dependence of stellar mass estimates on model choices and availability of the WISE photometry. The WISE information is mandatory to minimize the misclassification of star-forming galaxies as AGN. The lack of WISE bands in SED fits leads to elevated AGN fractions for 68% of star-forming galaxies identified using emission line diagnostic diagram but does not significantly affect their stellar mass nor star formation estimates., Comment: resubmitted after addressing minor referee comments

Explainable AI (XAI) is a rapidly growing domain with a myriad of proposed methods as well as metrics aiming to evaluate their efficacy. However, current studies are often of limited scope, examining only a handful of XAI methods and ignoring underlying design parameters for performance, such as the model architecture or the nature of input data. Moreover, they often rely on one or a few metrics and neglect thorough validation, increasing the risk of selection bias and ignoring discrepancies among metrics. These shortcomings leave practitioners confused about which method to choose for their problem. In response, we introduce LATEC, a large-scale benchmark that critically evaluates 17 prominent XAI methods using 20 distinct metrics. We systematically incorporate vital design parameters like varied architectures and diverse input modalities, resulting in 7,560 examined combinations. Through LATEC, we showcase the high risk of conflicting metrics leading to unreliable rankings and consequently propose a more robust evaluation scheme. Further, we comprehensively evaluate various XAI methods to assist practitioners in selecting appropriate methods aligning with their needs. Curiously, the emerging top-performing method, Expected Gradients, is not examined in any relevant related study. LATEC reinforces its role in future XAI research by publicly releasing all 326k saliency maps and 378k metric scores as a (meta-)evaluation dataset. The benchmark is hosted at: https://github.com/IML-DKFZ/latec., Comment: Accepted at NeurIPS 2024

We introduce a novel mesh-free and direct method for computing the shape derivative in PDE-constrained shape optimization problems. Our approach is based on a probabilistic representation of the shape derivative and is applicable for second-order semilinear elliptic PDEs with Dirichlet boundary conditions and a general class of target functions. The probabilistic representation derives from an extension of a boundary sensitivity result for diffusion processes due to Costantini, Gobet and El Karoui [14]. Moreover, we present a simulation methodology based on our results that does not necessarily require a mesh of the relevant domain, and provide Taylor tests to verify its numerical accuracy

State-of-the-art Large Language Models (LLMs) are accredited with an increasing number of different capabilities, ranging from reading comprehension, over advanced mathematical and reasoning skills to possessing scientific knowledge. In this paper we focus on their multi-hop reasoning capability: the ability to identify and integrate information from multiple textual sources. Given the concerns with the presence of simplifying cues in existing multi-hop reasoning benchmarks, which allow models to circumvent the reasoning requirement, we set out to investigate, whether LLMs are prone to exploiting such simplifying cues. We find evidence that they indeed circumvent the requirement to perform multi-hop reasoning, but they do so in more subtle ways than what was reported about their fine-tuned pre-trained language model (PLM) predecessors. Motivated by this finding, we propose a challenging multi-hop reasoning benchmark, by generating seemingly plausible multi-hop reasoning chains, which ultimately lead to incorrect answers. We evaluate multiple open and proprietary state-of-the-art LLMs, and find that their performance to perform multi-hop reasoning is affected, as indicated by up to 45% relative decrease in F1 score when presented with such seemingly plausible alternatives. We conduct a deeper analysis and find evidence that while LLMs tend to ignore misleading lexical cues, misleading reasoning paths indeed present a significant challenge., Comment: 15 pages, 3 figures, EMNLP 2024 Main Conference

We present new Galactic reddening maps of the high Galactic latitude sky using DESI imaging and spectroscopy. We directly measure the reddening of 2.6 million stars by comparing the observed stellar colors in $g-r$ and $r-z$ from DESI imaging with the synthetic colors derived from DESI spectra from the first two years of the survey. The reddening in the two colors is on average consistent with the \cite{fitzpatrick_correcting_1999} extinction curve with $R_\mathrm{V}=3.1$. We find that our reddening maps differ significantly from the commonly used \cite{schlegel_maps_1998} (SFD) reddening map (by up to 80 mmag in $E(B-V)$), and we attribute most of this difference to systematic errors in the SFD map. To validate the reddening map, we select a galaxy sample with extinction correction based on our reddening map, and this yields significantly better uniformity than the SFD extinction correction. Finally, we discuss the potential systematic errors in the DESI reddening measurements, including the photometric calibration errors that are the limiting factor on our accuracy. The $E(g-r)$ and $E(g-r)$ maps presented in this work, and for convenience their corresponding $E(B-V)$ maps with SFD calibration, are publicly available., Comment: Submitted to the Open Journal of Astrophysics. Associated data files: https://data.desi.lbl.gov/public/papers/mws/desi_dust/y2/v1/maps/

Multiplexed surveys have the ambition to grow larger for the next generation of focal plane instruments. Future projects such as Spec-S5, MUST, and WST have an ever-growing need for multi-object spectroscopy (13,000 - 20,000 simultaneous objects) which demands further investigations of novel focal plane instrumentation. In this paper, we present a rigorous study of focal plane coverage optimization and assembly of triangular modules of alpha-beta fiber positioners with a 6.2 mm pitch. The main focus here is to examine different module arrangements namely, framed, semi-frameless, and fullyframeless assemblies. Framed and semi-frameless describe here the usage of a manufactured focal plate to hold the modules together and provide the correct focus and tilt to the fibers. Work on automatically generating such focal plates for project adaptability and ease of manufacturing will also be presented. On the other hand, the frameless approach proposes a connection method freed from the need of a focal plate. The following paper will also present their capabilities to meet the requirements for focal plane assembly such as focus, tilt and coverage., Comment: 16 pages, 16 figures, SPIE Astronomical Telescopes + Instrumentation 2024

Measuring the growth of structure is a powerful probe for studying the dark sector, especially in light of the $\sigma_8$ tension between primary CMB anisotropy and low-redshift surveys. This paper provides a new measurement of the amplitude of the matter power spectrum, $\sigma_8$, using galaxy-galaxy and galaxy-CMB lensing power spectra of Dark Energy Spectroscopic Instrument Legacy Imaging Surveys Emission-Line Galaxies and the $\textit{Planck}$ 2018 CMB lensing map. We create an ELG catalog composed of $27$ million galaxies and with a purity of $85\%$, covering a redshift range $0 < z < 3$, with $z_{\rm mean} = 1.09$. We implement several novel systematic corrections, such as jointly modeling the contribution of imaging systematics and photometric redshift uncertainties to the covariance matrix. We also study the impacts of various dust maps on cosmological parameter inference. We measure the cross-power spectra over $f_{\rm sky} = 0.25$ with a signal-to-background ratio of up to $ 30\sigma$. We find that the choice of dust maps to account for imaging systematics in estimating the ELG overdensity field has a significant impact on the final estimated values of $\sigma_8$ and $\Omega_{\rm M}$, with far-infrared emission-based dust maps preferring $\sigma_8$ to be as low as $0.702 \pm 0.030$, and stellar-reddening-based dust maps preferring as high as $0.719 \pm 0.030$. The highest preferred value is at $\sim 3 \sigma$ tension with the $\textit{Planck}$ primary anisotropy results. These findings indicate a need for tomographic analyses at high redshifts and joint modeling of systematics., Comment: 50 pages, 24 figures (figure data can be obtained at https://zenodo.org/records/13381499)

The field of Explainable Artificial Intelligence (XAI) for Deep Neural Network models has developed significantly, offering numerous techniques to extract explanations from models. However, evaluating explanations is often not trivial, and differences in applied metrics can be subtle, especially with non-intelligible data. Thus, there is a need for visualizations tailored to explore explanations for domains with such data, e.g., time series. We propose DAVOTS, an interactive visual analytics approach to explore raw time series data, activations of neural networks, and attributions in a dense-pixel visualization to gain insights into the data, models' decisions, and explanations. To further support users in exploring large datasets, we apply clustering approaches to the visualized data domains to highlight groups and present ordering strategies for individual and combined data exploration to facilitate finding patterns. We visualize a CNN trained on the FordA dataset to demonstrate the approach., Comment: 5 pages, 2 figures, accepted at MLVIS 2023

Automatic Speech Recognition (ASR) systems are pivotal in transcribing speech into text, yet the errors they introduce can significantly degrade the performance of downstream tasks like summarization. This issue is particularly pronounced in clinical dialogue summarization, a low-resource domain where supervised data for fine-tuning is scarce, necessitating the use of ASR models as black-box solutions. Employing conventional data augmentation for enhancing the noise robustness of summarization models is not feasible either due to the unavailability of sufficient medical dialogue audio recordings and corresponding ASR transcripts. To address this challenge, we propose MEDSAGE, an approach for generating synthetic samples for data augmentation using Large Language Models (LLMs). Specifically, we leverage the in-context learning capabilities of LLMs and instruct them to generate ASR-like errors based on a few available medical dialogue examples with audio recordings. Experimental results show that LLMs can effectively model ASR noise, and incorporating this noisy data into the training process significantly improves the robustness and accuracy of medical dialogue summarization systems. This approach addresses the challenges of noisy ASR outputs in critical applications, offering a robust solution to enhance the reliability of clinical dialogue summarization.

The Dark Energy Spectroscopic Instrument (DESI) Peculiar Velocity Survey aims to measure the peculiar velocities of early and late type galaxies within the DESI footprint using both the Fundamental Plane and Tully-Fisher relations. Direct measurements of peculiar velocities can significantly improve constraints on the growth rate of structure, reducing uncertainty by a factor of approximately 2.5 at redshift 0.1 compared to the DESI Bright Galaxy Survey's redshift space distortion measurements alone. We assess the quality of stellar velocity dispersion measurements from DESI spectroscopic data. These measurements, along with photometric data from the Legacy Survey, establish the Fundamental Plane relation and determine distances and peculiar velocities of early-type galaxies. During Survey Validation, we obtain spectra for 6698 unique early-type galaxies, up to a photometric redshift of 0.15. 64\% of observed galaxies (4267) have relative velocity dispersion errors below 10\%. This percentage increases to 75\% if we restrict our sample to galaxies with spectroscopic redshifts below 0.1. We use the measured central velocity dispersion, along with photometry from the DESI Legacy Imaging Surveys, to fit the Fundamental Plane parameters using a 3D Gaussian maximum likelihood algorithm that accounts for measurement uncertainties and selection cuts. In addition, we conduct zero-point calibration using the absolute distance measurements to the Coma cluster, leading to a value of the Hubble constant, $H_0 = 76.05 \pm 0.35$(statistical) $\pm 0.49$(systematic FP) $\pm 4.86$(statistical due to calibration) $\mathrm{km \ s^{-1} Mpc^{-1}}$. This $H_0$ value is within $2\sigma$ of Planck Cosmic Microwave Background results and within $1\sigma$, of other low redshift distance indicator-based measurements., Comment: 18 pages, 9 figures, 2 tables. Submitted for publication in MNRAS

Large Language Models (LLMs) are increasingly adopted for applications in healthcare, reaching the performance of domain experts on tasks such as question answering and document summarisation. Despite their success on these tasks, it is unclear how well LLMs perform on tasks that are traditionally pursued in the biomedical domain, such as structured information extration. To breach this gap, in this paper, we systematically benchmark LLM performance in Medical Classification and Named Entity Recognition (NER) tasks. We aim to disentangle the contribution of different factors to the performance, particularly the impact of LLMs' task knowledge and reasoning capabilities, their (parametric) domain knowledge, and addition of external knowledge. To this end we evaluate various open LLMs -- including BioMistral and Llama-2 models -- on a diverse set of biomedical datasets, using standard prompting, Chain-of-Thought (CoT) and Self-Consistency based reasoning as well as Retrieval-Augmented Generation (RAG) with PubMed and Wikipedia corpora. Counter-intuitively, our results reveal that standard prompting consistently outperforms more complex techniques across both tasks, laying bare the limitations in the current application of CoT, self-consistency and RAG in the biomedical domain. Our findings suggest that advanced prompting methods developed for knowledge- or reasoning-intensive tasks, such as CoT or RAG, are not easily portable to biomedical tasks where precise structured outputs are required. This highlights the need for more effective integration of external knowledge and reasoning mechanisms in LLMs to enhance their performance in real-world biomedical applications., Comment: 11 pages

Medical abstractive summarization faces the challenge of balancing faithfulness and informativeness. Current methods often sacrifice key information for faithfulness or introduce confabulations when prioritizing informativeness. While recent advancements in techniques like in-context learning (ICL) and fine-tuning have improved medical summarization, they often overlook crucial aspects such as faithfulness and informativeness without considering advanced methods like model reasoning and self-improvement. Moreover, the field lacks a unified benchmark, hindering systematic evaluation due to varied metrics and datasets. This paper addresses these gaps by presenting a comprehensive benchmark of six advanced abstractive summarization methods across three diverse datasets using five standardized metrics. Building on these findings, we propose uMedSum, a modular hybrid summarization framework that introduces novel approaches for sequential confabulation removal followed by key missing information addition, ensuring both faithfulness and informativeness. Our work improves upon previous GPT-4-based state-of-the-art (SOTA) medical summarization methods, significantly outperforming them in both quantitative metrics and qualitative domain expert evaluations. Notably, we achieve an average relative performance improvement of 11.8% in reference-free metrics over the previous SOTA. Doctors prefer uMedSum's summaries 6 times more than previous SOTA in difficult cases where there are chances of confabulations or missing information. These results highlight uMedSum's effectiveness and generalizability across various datasets and metrics, marking a significant advancement in medical summarization., Comment: 12 pages

We propose an interactive methodology for generating counterfactual explanations for univariate time series data in classification tasks by leveraging 2D projections and decision boundary maps to tackle interpretability challenges. Our approach aims to enhance the transparency and understanding of deep learning models' decision processes. The application simplifies the time series data analysis by enabling users to interactively manipulate projected data points, providing intuitive insights through inverse projection techniques. By abstracting user interactions with the projected data points rather than the raw time series data, our method facilitates an intuitive generation of counterfactual explanations. This approach allows for a more straightforward exploration of univariate time series data, enabling users to manipulate data points to comprehend potential outcomes of hypothetical scenarios. We validate this method using the ECG5000 benchmark dataset, demonstrating significant improvements in interpretability and user understanding of time series classification. The results indicate a promising direction for enhancing explainable AI, with potential applications in various domains requiring transparent and interpretable deep learning models. Future work will explore the scalability of this method to multivariate time series data and its integration with other interpretability techniques., Comment: 14 pages, 4 figures, accepted at XKDD @ ECML-PKDD

Understanding how models process and interpret time series data remains a significant challenge in deep learning to enable applicability in safety-critical areas such as healthcare. In this paper, we introduce Sequence Dreaming, a technique that adapts Activation Maximization to analyze sequential information, aiming to enhance the interpretability of neural networks operating on univariate time series. By leveraging this method, we visualize the temporal dynamics and patterns most influential in model decision-making processes. To counteract the generation of unrealistic or excessively noisy sequences, we enhance Sequence Dreaming with a range of regularization techniques, including exponential smoothing. This approach ensures the production of sequences that more accurately reflect the critical features identified by the neural network. Our approach is tested on a time series classification dataset encompassing applications in predictive maintenance. The results show that our proposed Sequence Dreaming approach demonstrates targeted activation maximization for different use cases so that either centered class or border activation maximization can be generated. The results underscore the versatility of Sequence Dreaming in uncovering salient temporal features learned by neural networks, thereby advancing model transparency and trustworthiness in decision-critical domains., Comment: 16 pages, 4 figures, accepted at TempXAI @ ECML-PKDD

Over the past few years alone, the lensing community has discovered thousands of strong lens candidates, and spectroscopically confirmed hundreds of them. In this time of abundance, it becomes pragmatic to focus our time and resources on the few extraordinary systems, in order to most efficiently study the universe. In this paper, we present such a system: DESI-090.9854-35.9683, a cluster-scale lens at $z_{\rm l} = 0.49$, with seven observed lensed sources around the core, and additional lensed sources further out in the cluster. From the number and the textbook configuration of the lensed images, a tight constraint on the mass potential of the lens is possible. This would allow for detailed analysis on the dark and luminous matter content within galaxy clusters, as well as a probe into dark energy and high-redshift galaxies. We present our spatially resolved kinematic measurements of this system from the Very Large Telescope Multi Unit Spectroscopic Explorer, which confirm five of these source galaxies (in ascending order, at $z_{\rm s} = 0.962, 0.962, 1.166, 1.432,$ and $1.432$). With previous Hubble Space Telescope imaging in the F140W and F200LP bands, we also present a simple two power-law profile flux-based lens model that, for a cluster lens, well models the five lensed arc families with redshifts. We determine the mass to be $M(< \theta_{\rm E}) = 4.78\times10^{13} M_{\odot}$ for the primary mass potential. From the model, we extrapolate the redshift of one of the two source galaxies not yet spectroscopically confirmed to be at $z_{\rm s}=4.52^{+1.03}_{-0.71}$., Comment: 14 pages, 6 figures

Performance of NLP systems is typically evaluated by collecting a large-scale dataset by means of crowd-sourcing to train a data-driven model and evaluate it on a held-out portion of the data. This approach has been shown to suffer from spurious correlations and the lack of challenging examples that represent the diversity of natural language. Instead, we examine a framework for evaluating optimised models in training-set free setting on synthetically generated challenge sets. We find that despite the simplicity of the generation method, the data can compete with crowd-sourced datasets with regard to naturalness and lexical diversity for the purpose of evaluating the linguistic capabilities of MRC models. We conduct further experiments and show that state-of-the-art language model-based MRC systems can learn to succeed on the challenge set correctly, although, without capturing the general notion of the evaluated phenomenon.

We present a measurement of the mean absorption of cool gas traced by Mg II (${\lambda\lambda 2796, 2803}$) around emission line galaxies (ELGs), spanning spatial scales from 20 kpc to 10 Mpc. The measurement is based on cross-matching the positions of about 2.5 million ELGs at $z = 0.75-1.65$ and the metal absorption in the spectra of 1.4 million background quasars with data provided by the Year 1 sample of the Dark Energy Spectroscopic Instrument (DESI). The ELGs are divided into two redshift intervals: $0.75 < z < 1.0$ and $1.0 < z < 1.65$. We find that the composite spectra constructed by stacking the ELG-QSO pairs show evolution with redshift, with $z>1$ having a systematically higher signal of Mg II absorption. Within 1 Mpc, the covering fraction of the cool gas at $z > 1$ is higher than that of $z < 1$. The enhancement becomes less apparent especially if the projected distance $r_{p}>$1 Mpc. Also, ELGs with higher stellar mass and star formation rate (SFR) yield higher clustering of Mg II absorbers at $z<1$. For $z>1$, the covering fractions with different SFRs show little difference. The higher Mg II absorption at higher redshift also supports the observations of higher star formation at cosmic noon. Besides, the profile of Mg II absorption reveals a change of slope on scales of about 1 Mpc, consistent with the expected transition from a dark matter halo-dominated environment to a regime where clustering is dominated by halo-halo correlations. We estimate the cool gas density profile and derive the metal abundance at different redshifts. The growth of metal abundance suggests an increased presence of cool gas in the intergalactic medium (IGM) towards higher redshifts.

We show that in the single-parameter mechanism design environment, the only non-wasteful, symmetric, incentive compatible and sybil-proof mechanism is a second price auction with symmetric tie-breaking. Thus, if there is private information, lotteries or other mechanisms that do not always allocate to a highest-value bidder are not sybil-proof or not incentive compatible.

(abridged)Photometric redshifts for AGN (galaxies hosting an accreting supermassive black hole in their center) are notoriously challenging and currently better computed via SED fitting, assuming that deep photometry for many wavelengths is available. However, for AGN detected all-sky, the photometry is limited and provided by different projects. This makes the task of homogenising the data challenging and is a dramatic drawback for the millions of AGN that wide surveys like SRG/eROSITA will detect. This work aims to compute reliable photometric redshifts for X-ray-detected AGN using only one dataset that covers a large area: the 10th Data Release of the Imaging Legacy Survey (LS10) for DESI. LS10 provides deep grizW1-W4 forced photometry within various apertures, thus avoids issues related to the cross-calibration of surveys. We present the results from CircleZ, a machine-learning algorithm based on a Fully Connected Neural Network. CircleZ uses training sample of 14,000 X-ray-detected AGN and utilizes multi-aperture photometry. The accuracy and the fraction of outliers reached in a test sample of 2913 AGN are 0.067 and 11.6%, respectively. The results are comparable to or better than those obtained previously for the same field but with much less effort. We further tested the stability of the results by computing the photometric redshifts for the sources detected in CSC2 and Chandra-COSMOS Legacy, reaching comparable accuracy as in eFEDS when limiting the magnitude of the counterparts with respect to the depth of LS10. The method applies to fainter samples of AGN using deeper optical data from future surveys (e.g., LSST, Euclid), granted LS10-like information on the light distribution beyond a morphological type is provided. With the paper, we release an updated version of the photometric redshifts (including errors and probability distribution function) for eROSITA/eFEDS., Comment: A&A, paper accepted

We introduce an anomaly detection method for multivariate time series data with the aim of identifying critical periods and features influencing extreme climate events like snowmelt in the Arctic. This method leverages the Variational Autoencoder (VAE) integrated with dynamic thresholding and correlation-based feature clustering. This framework enhances the VAE's ability to identify localized dependencies and learn the temporal relationships in climate data, thereby improving the detection of anomalies as demonstrated by its higher F1-score on benchmark datasets. The study's main contributions include the development of a robust anomaly detection method, improving feature representation within VAEs through clustering, and creating a dynamic threshold algorithm for localized anomaly detection. This method offers explainability of climate anomalies across different regions., Comment: This work was presented at the 2024 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2024, 07-12 July 2024, Athens, Greece

We study the amount of maximal extractable value (MEV) captured by validators, as a function of searcher competition, in blockchains with competitive block building markets such as Ethereum. We argue that the core is a suitable solution concept in this context that makes robust predictions that are independent of implementation details or specific mechanisms chosen. We characterize how much value validators extract in the core and quantify the surplus share of validators as a function of searcher competition. Searchers can obtain at most the marginal value increase of the winning block relative to the best block that can be built without their bundles. Dually this gives a lower bound on the value extracted by the validator. If arbitrages are easy to find and many searchers find similar bundles, the validator gets paid all value almost surely, while searchers can capture most value if there is little searcher competition per arbitrage. For the case of passive block-proposers we study, moreover, mechanisms that implement core allocations in dominant strategies and find that for submodular value, there is a unique dominant-strategy incentive compatible core-selecting mechanism that gives each searcher exactly their marginal value contribution to the winning block. We validate our theoretical prediction empirically with aggregate bundle data and find a significant positive relation between the number of submitted backruns for the same opportunity and the median value captured by the proposer from the opportunity.

Recent advances in cosmological observations have provided an unprecedented opportunity to investigate the distribution of baryons relative to the underlying matter. In this work, we robustly show that the gas is much more extended than the dark matter at 40$\sigma$ and the amount of baryonic feedback at $z \lesssim 1$ strongly disfavors low-feedback models such as that of state-of-the-art hydrodynamical simulation IllustrisTNG compared with high-feedback models such as that of the original Illustris simulation. This has important implications for bridging the gap between theory and observations and understanding galaxy formation and evolution. Furthermore, a better grasp of the baryon-dark matter link is critical to future cosmological analyses, which are currently impeded by our limited knowledge of baryonic feedback. Here, we measure the kinematic Sunyaev-Zel'dovich (kSZ) effect from the Atacama Cosmology Telescope (ACT), stacked on the luminous red galaxy (LRG) sample of the Dark Energy Spectroscopic Instrument (DESI) imaging survey. This is the first analysis to use photometric redshifts for reconstructing galaxy velocities. Due to the large number of galaxies comprising the DESI imaging survey, this is the highest signal-to-noise stacked kSZ measurement to date: we detect the signal at 13$\sigma$ and find that the gas is more spread out than the dark matter at $\sim$40$\sigma$. Our work opens up the possibility to recalibrate large hydrodynamical simulations using the kSZ effect. In addition, our findings point towards a way of alleviating inconsistencies between weak lensing surveys and cosmic microwave background (CMB) experiments such as the `low $S_8$' tension, and shed light on long-standing enigmas in astrophysics such as the `missing baryon' problem., Comment: 20 pages, 8 figures, submitting to PRL

We present ~ 126 new spectroscopically identified members of the GD-1 tidal stream obtained with the 5000-fiber Dark Energy Spectroscopic Instrument (DESI). We confirm the existence of a ``cocoon'' which is broad (FWHM~2.932deg~460pc) and kinematically hot (velocity dispersion, sigma~5-8km/s) component that surrounds a narrower (FWHM~0.353deg~55pc) and colder (sigma~ 2.2-2.6km/s) thin stream component (based on a median per star velocity precision of 2.7km/s). The cocoon extends over at least a ~ 20deg segment of the stream observed by DESI. The thin and cocoon components have similar mean values of [Fe/H]: -2.54+/- 0.04dex and -2.45+/-0.06dex suggestive of a common origin. The data are consistent with the following scenarios for the origin of the cocoon. The progenitor of the GD-1 stream was an accreted globular cluster (GC) and: (a) the cocoon was produced by pre-accretion tidal stripping of the GC while it was still inside its parent dwarf galaxy; (b) the cocoon is debris from the parent dwarf galaxy; (c) an initially thin GC tidal stream was heated by impacts from dark subhalos in the Milky Way; (d) an initially thin GC stream was heated by a massive Sagittarius dwarf galaxy; or a combination of some these. In the first two cases the velocity dispersion and mean metallicity are consistent with the parent dwarf galaxy having a halo mass of ~0^9\msun. Future DESI spectroscopy and detailed modeling may enable us to distinguish between these possible origins., Comment: Submitted to ApJ, 23 pages, 13 figures 4 tables

In this work we use Lagrangian perturbation theory to analyze the harmonic space galaxy clustering signal of Bright Galaxy Survey (BGS) and Luminous Red Galaxies (LRGs) targeted by the Dark Energy Spectroscopic Instrument (DESI), combined with the galaxy--galaxy lensing signal measured around these galaxies using Dark Energy Survey Year 3 source galaxies. The BGS and LRG galaxies are extremely well characterized by DESI spectroscopy and, as a result, lens galaxy redshift uncertainty and photometric systematics contribute negligibly to the error budget of our ``$2\times2$-point'' analysis. On the modeling side, this work represents the first application of the \texttt{spinosaurus} code, implementing an effective field theory model for galaxy intrinsic alignments, and we additionally introduce a new scheme (\texttt{MAIAR}) for marginalizing over the large uncertainties in the redshift evolution of the intrinsic alignment signal. Furthermore, this is the first application of a hybrid effective field theory (HEFT) model for galaxy bias based on the $\texttt{Aemulus}\, \nu$ simulations. Our main result is a measurement of the amplitude of the lensing signal, $S_8=\sigma_8 \left(\Omega_m/0.3\right)^{0.5} = 0.850^{+0.042}_{-0.050}$, consistent with values of this parameter derived from the primary CMB. This constraint is artificially improved by a factor of $51\%$ if we assume a more standard, but restrictive parameterization for the redshift evolution and sample dependence of the intrinsic alignment signal, and $63\%$ if we additionally assume the nonlinear alignment model. We show that when fixing the cosmological model to the best-fit values from Planck PR4 there is $> 5 \sigma$ evidence for a deviation of the evolution of the intrinsic alignment signal from the functional form that is usually assumed in cosmic shear and galaxy--galaxy lensing studies., Comment: 53 pages, 25 figures, updated to match version accepted by PRD

We infer the growth of large scale structure over the redshift range $0.4\lesssim z \lesssim 1$ from the cross-correlation of spectroscopically calibrated Luminous Red Galaxies (LRGs) selected from the Dark Energy Spectroscopic Instrument (DESI) legacy imaging survey with CMB lensing maps reconstructed from the latest Planck and ACT data. We adopt a hybrid effective field theory (HEFT) model that robustly regulates the cosmological information obtainable from smaller scales, such that our cosmological constraints are reliably derived from the (predominantly) linear regime. We perform an extensive set of bandpower- and parameter-level systematics checks to ensure the robustness of our results and to characterize the uniformity of the LRG sample. We demonstrate that our results are stable to a wide range of modeling assumptions, finding excellent agreement with a linear theory analysis performed on a restricted range of scales. From a tomographic analysis of the four LRG photometric redshift bins we find that the rate of structure growth is consistent with $\Lambda$CDM with an overall amplitude that is $\simeq5-7\%$ lower than predicted by primary CMB measurements with modest $(\sim2\sigma)$ statistical significance. From the combined analysis of all four bins and their cross-correlations with Planck we obtain $S_8 = 0.765\pm0.023$, which is less discrepant with primary CMB measurements than previous DESI LRG cross Planck CMB lensing results. From the cross-correlation with ACT we obtain $S_8 = 0.790^{+0.024}_{-0.027}$, while when jointly analyzing Planck and ACT we find $S_8 = 0.775^{+0.019}_{-0.022}$ from our data alone and $\sigma_8 = 0.772^{+0.020}_{-0.023}$ with the addition of BAO data. These constraints are consistent with the latest Planck primary CMB analyses at the $\simeq 1.6-2.2\sigma$ level, and are in excellent agreement with galaxy lensing surveys., Comment: 60 pages, 26 figures, comments welcome

We present a high-significance cross-correlation of CMB lensing maps from the Atacama Cosmology Telescope (ACT) Data Release 6 (DR6) with spectroscopically calibrated luminous red galaxies (LRGs) from the Dark Energy Spectroscopic Instrument (DESI). We detect this cross-correlation at a significance of 38$\sigma$; combining our measurement with the Planck Public Release 4 (PR4) lensing map, we detect the cross-correlation at 50$\sigma$. Fitting this jointly with the galaxy auto-correlation power spectrum to break the galaxy bias degeneracy with $\sigma_8$, we perform a tomographic analysis in four LRG redshift bins spanning $0.4 \le z \le 1.0$ to constrain the amplitude of matter density fluctuations through the parameter combination $S_8^\times = \sigma_8 \left(\Omega_m / 0.3\right)^{0.4}$. Prior to unblinding, we confirm with extragalactic simulations that foreground biases are negligible and carry out a comprehensive suite of null and consistency tests. Using a hybrid effective field theory (HEFT) model that allows scales as small as $k_{\rm max}=0.6$ $h/{\rm Mpc}$, we obtain a 3.3% constraint on $S_8^\times = \sigma_8 \left(\Omega_m / 0.3\right)^{0.4} = 0.792^{+0.024}_{-0.028}$ from ACT data, as well as constraints on $S_8^\times(z)$ that probe structure formation over cosmic time. Our result is consistent with the early-universe extrapolation from primary CMB anisotropies measured by Planck PR4 within 1.2$\sigma$. Jointly fitting ACT and Planck lensing cross-correlations we obtain a 2.7% constraint of $S_8^\times = 0.776^{+0.019}_{-0.021}$, which is consistent with the Planck early-universe extrapolation within 2.1$\sigma$, with the lowest redshift bin showing the largest difference in mean. The latter may motivate further CMB lensing tomography analyses at $z<0.6$ to assess the impact of potential systematics or the consistency of the $\Lambda$CDM model over cosmic time., Comment: Prepared for submission to JCAP (47 pages, 13 figures)

We relate the theory of purity of a locally finitely presented category with products to the study of exact structures on the full subcategory of finitely presented objects. Properties in the context of purity are translated to properties about exact structures. We specialize to the case of a module category over an Artin algebra and show that generic modules are in one to one correspondence with particular maximal exact structures.

Keypoint data has received a considerable amount of attention in machine learning for tasks like action detection and recognition. However, human experts in movement such as doctors, physiotherapists, sports scientists and coaches use a notion of joint angles standardised by the International Society of Biomechanics to precisely and efficiently communicate static body poses and movements. In this paper, we introduce the basic biomechanical notions and show how they can be used to convert common keypoint data into joint angles that uniquely describe the given pose and have various desirable mathematical properties, such as independence of both the camera viewpoint and the person performing the action. We experimentally demonstrate that the joint angle representation of keypoint data is suitable for machine learning applications and can in some cases bring an immediate performance gain. The use of joint angles as a human meaningful representation of kinematic data is in particular promising for applications where interpretability and dialog with human experts is important, such as many sports and medical applications. To facilitate further research in this direction, we will release a python package to convert keypoint data into joint angles as outlined in this paper.

We demonstrate an imageless method of concealed contraband detection using a real-time 75 GHz rotationally dynamic antenna array. The array measures information in the two-dimensional Fourier domain and captures a set of samples that is sufficient for detecting concealed objects yet insufficient for generating full image, thereby preserving the privacy of screened subjects. The small set of Fourier samples contains sharp spatial frequency features in the Fourier domain which correspond to sharp edges of man-made objects such as handguns. We evaluate a set of classification methods: threshold-based, K-nearest neighbor, and support vector machine using radial basis function; all operating on arithmetic features directly extracted from the sampled Fourier-domain responses measured by a dynamically rotating millimeter-wave active interferometer. Noise transmitters are used to produce thermal-like radiation from scenes, enabling direct Fourier-domain sampling, while the rotational dynamics circularly sample the two-dimensional Fourier domain, capturing the sharp-edge induced responses. We experimentally demonstrate the detection of concealed metallic gun-shape object beneath clothing on a real person in a laboratory environment and achieved an accuracy and F1-score both at 0.986. The presented technique not only prevents image formation due to efficient Fourier-domain space sub-sampling but also requires only 211 ms from measurement to decision., Comment: This work has been submitted to the IEEE for possible publication

We present a method to mitigate the effects of fiber assignment incompleteness in two-point power spectrum and correlation function measurements from galaxy spectroscopic surveys, by truncating small angular scales from estimators. We derive the corresponding modified correlation function and power spectrum windows to account for the small angular scale truncation in the theory prediction. We validate this approach on simulations reproducing the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 (DR1) with and without fiber assignment. We show that we recover unbiased cosmological constraints using small angular scale truncated estimators from simulations with fiber assignment incompleteness, with respect to standard estimators from complete simulations. Additionally, we present an approach to remove the sensitivity of the fits to high $k$ modes in the theoretical power spectrum, by applying a transformation to the data vector and window matrix. We find that our method efficiently mitigates the effect of fiber assignment incompleteness in two-point correlation function and power spectrum measurements, at low computational cost and with little statistical loss., Comment: 36 pages, 23 figures, typos corrected, clarifications added

With the recent advances of large language models (LLMs), it is no longer infeasible to build an automated debate system that helps people to synthesise persuasive arguments. Previous work attempted this task by integrating multiple components. In our work, we introduce an argument mining dataset that captures the end-to-end process of preparing an argumentative essay for a debate, which covers the tasks of claim and evidence identification (Task 1 ED), evidence convincingness ranking (Task 2 ECR), argumentative essay summarisation and human preference ranking (Task 3 ASR) and metric learning for automated evaluation of resulting essays, based on human feedback along argument quality dimensions (Task 4 SQE). Our dataset contains 14k examples of claims that are fully annotated with the various properties supporting the aforementioned tasks. We evaluate multiple generative baselines for each of these tasks, including representative LLMs. We find, that while they show promising results on individual tasks in our benchmark, their end-to-end performance on all four tasks in succession deteriorates significantly, both in automated measures as well as in human-centred evaluation. This challenge presented by our proposed dataset motivates future research on end-to-end argument mining and summarisation. The repository of this project is available at https://github.com/HaoBytes/ArgSum-Datatset, Comment: Published on ACL 2024 Findings

There is vivid research on adapting Large Language Models (LLMs) to perform a variety of tasks in high-stakes domains such as healthcare. Despite their popularity, there is a lack of understanding of the extent and contributing factors that allow LLMs to recall relevant knowledge and combine it with presented information in the clinical and biomedical domain: a fundamental pre-requisite for success on down-stream tasks. Addressing this gap, we use Multiple Choice and Abstractive Question Answering to conduct a large-scale empirical study on 22 datasets in three generalist and three specialist biomedical sub-domains. Our multifaceted analysis of the performance of 15 LLMs, further broken down by sub-domain, source of knowledge and model architecture, uncovers success factors such as instruction tuning that lead to improved recall and comprehension. We further show that while recently proposed domain-adapted models may lack adequate knowledge, directly fine-tuning on our collected medical knowledge datasets shows encouraging results, even generalising to unseen specialist sub-domains. We complement the quantitative results with a skill-oriented manual error analysis, which reveals a significant gap between the models' capabilities to simply recall necessary knowledge and to integrate it with the presented context. To foster research and collaboration in this field we share M-QALM, our resources, standardised methodology, and evaluation results, with the research community to facilitate further advancements in clinical knowledge representation learning within language models., Comment: Accepted at ACL 2024 (Findings)

We measure the clustering of Lyman Alpha Emitting galaxies (LAEs) selected from the One-hundred-square-degree DECam Imaging in Narrowbands (ODIN) survey, with spectroscopic follow-up from Dark Energy Spectroscopic Instrument (DESI). We use DESI spectroscopy to optimize our selection and to constrain the interloper fraction and redshift distribution of our narrow-band selected sources. We select samples of 4000 LAEs at z=2.45 and 3.1 in 9 sq.deg. centered on the COSMOS field with median LyA fluxes of 10^{-16}erg/s/cm2. Covariances and cosmological inferences are obtained from a series of mock catalogs built upon high-resolution N-body simulations that match the footprint, number density, redshift distribution and observed clustering of the sample. We find that both samples have a correlation length of r_0=(3.0\pm 0.2)Mpc/h. Within our fiducial cosmology these correspond to 3D number densities of 10^{-3} h^3/Mpc^3 and, from our mock catalogs, biases of 1.7 and 2.0 at z=2.45 and 3.1, respectively. We discuss the implications of these measurements for the use of LAEs as large-scale structure tracers for high-redshift cosmology., Comment: 26 pages, 13 figures; minor revisions to match version accepted by JCAP