Search

JWST has enabled detecting and spatially resolving the heavily dust-attenuated stellar populations of sub-millimeter galaxies, revealing detail that was previously inaccessible. In this work we construct a sample of 289 sub-millimeter galaxies with detailed joint ALMA and JWST constraints in the COSMOS field. Sources are originally selected using the SCUBA-2 instrument and have archival ALMA observations from various programs. Their JWST NIRCam imaging is from COSMOS-Web and PRIMER. We extract multi-wavelength photometry in a manner that leverages the unprecedented near-infrared spatial resolution of JWST, and fit the data with spectral energy distribution models to derive photometric redshifts, stellar masses, star-formation rates and optical attenuation. The sample has an average z=2.6, A_V=2.5, SFR=270 and log(M*)=11.1. There are 81 (30%) galaxies that have no previous optical/near-infrared detections, including 75% of the z>4 sub-sample (n=28). The faintest observed near-infrared sources have the highest redshifts and largest A_V=4. In a preliminary morphology analysis we find that ~10% of our sample exhibit spiral arms and 5% host stellar bars, with one candidate bar found at z>3. Finally, we find that the clustering of JWST galaxies within 10 arcseconds of a sub-mm galaxy is a factor of 2 greater than what is expected based on either random clustering or the distribution of sources around any red galaxy irrespective of a sub-mm detection., Comment: 37 pages (15 for RGBs + references), 14 figures, submitted to ApJ

The surface brightness distribution of massive early-type galaxies (ETGs) often deviates from a perfectly elliptical shape. To capture these deviations in their isophotes during an ellipse fitting analysis, Fourier modes of order $m = 3, 4$ are often used. In such analyses the centre of each ellipse is treated as a free parameter, which may result in offsets from the centre of light, particularly for ellipses in the outer regions. This complexity is not currently accounted for in the mass models used in either strong gravitational lensing or galactic dynamical studies. In this work, we adopt a different approach, using the $m=1$ Fourier mode to account for this complexity while keeping the centres of all perturbed ellipses fixed, showing that it fits the data equally well. We applied our method to the distribution of light emission to a sample of ETGs from the MASSIVE survey and found that the majority have low $m_1$ amplitudes, below 2 percent. Five out of the 30 galaxies we analysed have high $m_1$ amplitudes, ranging from 2 to 10 percent in the outer parts ($R \gtrsim 3$ kpc), all of which have a physically associated companion. Based on our findings, we advocate the use of the $m=1$ multipole in the mass models used in strong lensing and dynamical studies, particularly for galaxies with recent or ongoing interactions., Comment: 7 pages, 6 figures. Submitted to MNRAS

We examine the morphological and kinematical properties of SPT-2147, a strongly lensed, massive, dusty, star-forming galaxy at $z = 3.762$. Combining data from JWST, HST, and ALMA, we study the galaxy's stellar emission, dust continuum and gas properties. The imaging reveals a central bar structure in the stars and gas embedded within an extended disc with a spiral arm-like feature. The kinematics confirm the presence of the bar and of the regularly rotating disc. Dynamical modeling yields a dynamical mass, ${M}_{\rm dyn} = (9.7 \pm 2.0) \times 10^{10}$ ${\rm M}_{\odot}$, and a maximum rotational velocity to velocity dispersion ratio, $V / \sigma = 9.8 \pm 1.2$. From multi-band imaging we infer, via SED fitting, a stellar mass, ${M}_{\star} = (6.3 \pm 0.9) \times 10^{10}$ $\rm{M}_{\odot}$, and a star formation rate, ${\rm SFR} = 781 \pm 99$ ${\rm M_{\odot} yr^{-1}}$, after correcting for magnification. Combining these measurements with the molecular gas mass, we derive a baryonic-to-total mass ratio of ${M}_{\rm bar} / {M}_{\rm dyn} = 0.9 \pm 0.2$ within 4.0 kpc. This finding suggests that the formation of bars in galaxies begins earlier in the history of the Universe than previously thought and can also occur in galaxies with elevated gas fractions., Comment: 19 pages, 11 figures. Submitted to MNRAS

In a strong gravitational lensing system, the distorted light from a source is analysed to infer the properties of the lens. However, light emitted by the lens itself can contaminate the image of the source, introducing systematic errors in the analysis. We present a simple and efficient lens light model based on the well-tested multi-Gaussian expansion (MGE) method for representing galaxy surface brightness profiles, which we combine with a semi-linear inversion scheme for pixelized source modelling. Testing it against realistic mock lensing images, we show that our scheme can fit the lensed images to the noise level, with relative differences between the true input and best-fit lens light model remaining below 5%. We apply the MGE lens light model to 38 lenses from the HST SLACS sample. We find that the new scheme provides a good fit for the majority of the sample with only 3 exceptions -- these show clear asymmetric residuals in the lens light. We examine the radial dependence of the ellipticity and position angles and confirm that it is common for a typical lens galaxy to exhibit twisting, non-elliptical isophotes and boxy / disky isophotes. Our MGE lens light model will be a valuable tool for understanding the hidden complexity of the lens mass distribution., Comment: 22 pages, 15 figures. Submitted to MNRAS. Comments Welcome

We present a new method for modelling the kinematics of galaxies from interferometric observations by performing the optimization of the kinematic model parameters directly in visibility-space instead of the conventional approach of fitting velocity fields produced with the CLEAN algorithm in real-space. We demonstrate our method on ALMA observations of $^{12}$CO (2$-$1), (3$-$2) or (4$-$3) emission lines from an initial sample of 30 massive 850$\mu$m-selected dusty star-forming galaxies with far-infrared luminosities $\gtrsim$$\,10^{12}\,$L$_{\odot}$ in the redshift range $z \sim\,$1.2$-$4.7. Using the results from our modelling analysis for the 12 sources with the highest signal-to-noise emission lines and disk-like kinematics, we conclude the following: (i) Our sample prefers a CO-to-$H_2$ conversion factor, of $\alpha_{\rm CO} = 0.92 \pm 0.36$; (ii) These far-infrared luminous galaxies follow a similar Tully$-$Fisher relation between the circularized velocity, $V_{\rm circ}$, and baryonic mass, $M_{\rm b}$, as more typical star-forming samples at high redshift, but extend this relation to much higher masses $-$ showing that these are some of the most massive disk-like galaxies in the Universe; (iii) Finally, we demonstrate support for an evolutionary link between massive high-redshift dusty star-forming galaxies and the formation of local early-type galaxies using the both the distributions of the baryonic and kinematic masses of these two populations on the $M_{\rm b}\,-\,\sigma$ plane and their relative space densities.

We have carried out HST snapshot observations at 1.1 $\mu$m of 281 candidate strongly lensed galaxies identified in the wide-area extragalactic surveys conducted with the Herschel space observatory. Our candidates comprise systems with flux densities at $500\,\mu$m$ S_{500}\geq 80$ mJy. We model and subtract the surface brightness distribution for 130 systems, where we identify a candidate for the foreground lens candidate. After combining visual inspection, archival high-resolution observations, and lens subtraction, we divide the systems into different classes according to their lensing likelihood. We confirm 65 systems to be lensed. Of these, 30 are new discoveries. We successfully perform lens modelling and source reconstruction on 23 systems, where the foreground lenses are isolated galaxies and the background sources are detected in the HST images. All the systems are successfully modelled as a singular isothermal ellipsoid. The Einstein radii of the lenses and the magnifications of the background sources are consistent with previous studies. However, the background source circularised radii (between 0.34 kpc and 1.30 kpc) are $\sim$3 times smaller than the ones measured in the sub-mm/mm for a similarly selected and partially overlapping sample. We compare our lenses with those in the SLACS survey, confirming that our lens-independent selection is more effective at picking up fainter and diffuse galaxies and group lenses. This sample represents the first step towards characterising the near-IR properties and stellar masses of the gravitationally lensed dusty star-forming galaxies., Comment: 57 pages, 18 figures, 11 tables. Accepted for publication in MNRAS

Aims. We provide an in-depth analysis of the COSMOS-Web ring, an Einstein ring at z=2 that we serendipitously discovered in the COSMOS-Web survey and possibly the most distant lens discovered to date. Methods. We extract the visible and NIR photometry from more than 25 bands and we derive the photometric redshifts and physical properties of both the lens and the source with three different SED fitting codes. Using JWST/NIRCam images, we also produce two lens models to (i) recover the total mass of the lens, (ii) derive the magnification of the system, (iii) reconstruct the morphology of the lensed source, and (iv) measure the slope of the total mass density profile of the lens. Results. The lens is a very massive and quiescent (sSFR < 10^(-13) yr-1) elliptical galaxy at z = 2.02 \pm 0.02 with a total mass Mtot(

Supermassive black holes (SMBHs) are a key catalyst of galaxy formation and evolution, leading to an observed correlation between SMBH mass $M_{\rm BH}$ and host galaxy velocity dispersion $\sigma_{\rm e}$. Outside the local Universe, measurements of $M_{\rm BH}$ are usually only possible for SMBHs in an active state: limiting sample size and introducing selection biases. Gravitational lensing makes it possible to measure the mass of non-active SMBHs. We present models of the $z=0.169$ galaxy-scale strong lens Abell~1201. A cD galaxy in a galaxy cluster, it has sufficient `external shear' that a magnified image of a $z = 0.451$ background galaxy is projected just $\sim 1$ kpc from the galaxy centre. Using multi-band Hubble Space Telescope imaging and the lens modeling software $\texttt{PyAutoLens}$ we reconstruct the distribution of mass along this line of sight. Bayesian model comparison favours a point mass with $M_{\rm BH} = 3.27 \pm 2.12\times10^{10}\,$M$_{\rm \odot}$ (3$\sigma$ confidence limit); an ultramassive black hole. One model gives a comparable Bayesian evidence without a SMBH, however we argue this model is nonphysical given its base assumptions. This model still provides an upper limit of $M_{\rm BH} \leq 5.3 \times 10^{10}\,$M$_{\rm \odot}$, because a SMBH above this mass deforms the lensed image $\sim 1$ kpc from Abell 1201's centre. This builds on previous work using central images to place upper limits on $M_{\rm BH}$, but is the first to also place a lower limit and without a central image being observed. The success of this method suggests that surveys during the next decade could measure thousands more SMBH masses, and any redshift evolution of the $M_{\rm BH}$--$\sigma_{\rm e}$ relation. Results are available at https://github.com/Jammy2211/autolens_abell_1201., Comment: Accepted in MNRAS, 27 pages, 22 figures

We analyse the molecular and atomic emission lines of 71 bright Herschel-selected galaxies between redshifts 1.4 to 4.6 detected by the Atacama Large Millimetre/submillimetre Array. These lines include a total of 156 CO, [C I], and H2O emission lines. For 46 galaxies, we detect two transitions of CO lines, and for these galaxies we find gas properties similar to those of other dusty star-forming galaxy (DSFG) samples. A comparison to photo-dissociation models suggests that most of Herschel-selected galaxies have similar interstellar medium conditions as local infrared-luminous galaxies and high-redshift DSFGs, although with denser gas and more intense far-ultraviolet radiation fields than normal star-forming galaxies. The line luminosities agree with the luminosity scaling relations across five orders of magnitude, although the star-formation and gas surface density distributions (i.e., Schmidt-Kennicutt relation) suggest a different star-formation phase in our galaxies (and other DSFGs) compared to local and low-redshift gas-rich, normal star-forming systems. The gas-to-dust ratios of these galaxies are similar to Milky Way values, with no apparent redshift evolution. Four of 46 sources appear to have CO line ratios in excess of the expected maximum (thermalized) profile, suggesting a rare phase in the evolution of DSFGs. Finally, we create a deep stacked spectrum over a wide rest-frame frequency (220-890 GHz) that reveals faint transitions from HCN and CH, in line with previous stacking experiments., Comment: 30 pages, 17 figures, accepted for publication in Monthly Notices of the Royal Astronomical Society Main Journal. Comments are warmly welcomed

The distribution of mass in galaxy-scale strong gravitational lenses is often modelled as an elliptical power law plus 'external shear', which notionally accounts for neighbouring galaxies and cosmic shear. We show that it does not. Except in a handful of rare systems, the best-fit values of external shear do not correlate with independent measurements of shear: from weak lensing in 45 Hubble Space Telescope images, or in 50 mock images of lenses with complex distributions of mass. Instead, the best-fit shear is aligned with the major or minor axis of 88% of lens galaxies; and the amplitude of the external shear increases if that galaxy is disky. We conclude that 'external shear' attached to a power law model is not physically meaningful, but a fudge to compensate for lack of model complexity. Since it biases other model parameters that are interpreted as physically meaningful in several science analyses (e.g. measuring galaxy evolution, dark matter physics or cosmological parameters), we recommend that future studies of galaxy-scale strong lensing should employ more flexible mass models., Comment: 13 pages, 11 figures, submitted to MNRAS and Review Response Submitted

We present 101 and 151 GHz ALMA continuum images for 85 fields selected from Herschel observations that have 500 micron flux densities >80 mJy and 250-500 micron colours consistent with z > 2, most of which are expected to be gravitationally lensed or hyperluminous infrared galaxies. Approximately half of the Herschel 500 micron sources were resolved into multiple ALMA sources, but 11 of the 15 brightest 500 micron Herschel sources correspond to individual ALMA sources. For the 37 fields containing either a single source with a spectroscopic redshift or two sources with the same spectroscopic redshift, we examined the colour temperatures and dust emissivity indices. The colour temperatures only vary weakly with redshift and are statistically consistent with no redshift-dependent temperature variations, which generally corresponds to results from other samples selected in far-infrared, submillimetre, or millimetre bands but not to results from samples selected in optical or near-infrared bands. The dust emissivity indices, with very few exceptions, are largely consistent with a value of 2. We also compared spectroscopic redshifts to photometric redshifts based on spectral energy distribution templates designed for infrared-bright high-redshift galaxies. While the templates systematically underestimate the redshifts by ~15%, the inclusion of ALMA data decreases the scatter in the predicted redshifts by a factor of ~2, illustrating the potential usefulness of these millimetre data for estimating photometric redshifts., Comment: Accepted for publication in Monthly Notices of the Royal Astronomical Society

Although large language models (LLMs) have been touted for their ability to generate natural-sounding text, there are growing concerns around possible negative effects of LLMs such as data memorization, bias, and inappropriate language. Unfortunately, the complexity and generation capacities of LLMs make validating (and correcting) such concerns difficult. In this work, we introduce ReLM, a system for validating and querying LLMs using standard regular expressions. ReLM formalizes and enables a broad range of language model evaluations, reducing complex evaluation rules to simple regular expression queries. Our results exploring queries surrounding memorization, gender bias, toxicity, and language understanding show that ReLM achieves up to 15x higher system efficiency, 2.5x data efficiency, and increased statistical and prompt-tuning coverage compared to state-of-the-art ad-hoc queries. ReLM offers a competitive and general baseline for the increasingly important problem of LLM validation.

We present the survey design, implementation, and outlook for COSMOS-Web, a 255 hour treasury program conducted by the James Webb Space Telescope in its first cycle of observations. COSMOS-Web is a contiguous 0.54 deg$^2$ NIRCam imaging survey in four filters (F115W, F150W, F277W, and F444W) that will reach 5$\sigma$ point source depths ranging $\sim$27.5-28.2 magnitudes. In parallel, we will obtain 0.19 deg$^2$ of MIRI imaging in one filter (F770W) reaching 5$\sigma$ point source depths of $\sim$25.3-26.0 magnitudes. COSMOS-Web will build on the rich heritage of multiwavelength observations and data products available in the COSMOS field. The design of COSMOS-Web is motivated by three primary science goals: (1) to discover thousands of galaxies in the Epoch of Reionization ($64$ and place constraints on the formation of the Universe's most massive galaxies ($M_\star>10^{10}$\,M$_\odot$), and (3) directly measure the evolution of the stellar mass to halo mass relation using weak gravitational lensing out to $z\sim2.5$ and measure its variance with galaxies' star formation histories and morphologies. In addition, we anticipate COSMOS-Web's legacy value to reach far beyond these scientific goals, touching many other areas of astrophysics, such as the identification of the first direct collapse black hole candidates, ultracool sub-dwarf stars in the Galactic halo, and possibly the identification of $z>10$ pair-instability supernovae. In this paper we provide an overview of the survey's key measurements, specifications, goals, and prospects for new discovery., Comment: 46 pages, 16 figures, ApJ accepted

The cold dark matter (DM) model predicts that every galaxy contains thousands of DM subhalos; almost all other DM models include a physical process that smooths away the subhalos. The subhalos are invisible, but could be detected via strong gravitational lensing, if they lie on the line of sight to a multiply-imaged background source, and perturb its apparent shape. We present a predominantly automated strong lens analysis framework, and scan for DM subhalos in Hubble Space Telescope imaging of 54 strong lenses. We identify five DM subhalo candidates, including two especially compelling candidates (one previously known in SLACS0946+1006) where a subhalo is favoured after all of our tests for systematics. We find that the detectability of subhalos depends upon the assumed parametric form for the lens galaxy's mass distribution, especially its degree of azimuthal freedom. Using separate components for dark matter and stellar mass reveals two DM subhalo candidates and removes four false-positives compared to the single power-law mass model that is common in the literature. We identify 45 lenses without substructures, the number of which is key to statistical tests able to rule out models of e.g. warm or self-interacting DM. Our full analysis results are available at https://github.com/Jammy2211/autolens_subhalo., Comment: 25 Pages, 15 Figures

Recordings of complex neural population responses provide a unique opportunity for advancing our understanding of neural information processing at multiple scales and improving performance of brain computer interfaces. However, most existing analytical techniques fall short of capturing the complexity of interactions within the concerted population activity. Vine copula-based approaches have shown to be successful at addressing complex high-order dependencies within the population, disentangled from the single-neuron statistics. However, most applications have focused on parametric copulas which bear the risk of misspecifying dependence structures. In order to avoid this risk, we adopted a fully non-parametric approach for the single-neuron margins and copulas by using Neural Spline Flows (NSF). We validated the NSF framework on simulated data of continuous and discrete type with various forms of dependency structures and with different dimensionality. Overall, NSFs performed similarly to existing non-parametric estimators, while allowing for considerably faster and more flexible sampling which also enables faster Monte Carlo estimation of copula entropy. Moreover, our framework was able to capture low and higher order heavy tail dependencies in neuronal responses recorded in the mouse primary visual cortex during a visual learning task while the animal was navigating a virtual reality environment. These findings highlight an often ignored aspect of complexity in coordinated neuronal activity which can be important for understanding and deciphering collective neural dynamics for neurotechnological applications.

Observations suggest that the dark matter and stars in early-type galaxies `conspire' to produce a surprisingly simple distribution of total mass, $\rho(r)\propto\rho^{-\gamma}$, with $\gamma\approx2$. We measure the distribution of mass in 48 early-type galaxies that gravitationally lens a resolved background source. By fitting the source light in every pixel of images from the Hubble Space Telescope, we find a mean $\langle\gamma\rangle=2.075_{-0.024}^{+0.023}$ with intrinsic scatter between galaxies of $\sigma_\gamma=0.172^{+0.022}_{-0.032}$ for the overall sample. This is consistent with, and has similar precision to traditional techniques that employ spectroscopic observations to supplement lensing with mass estimates from stellar dynamics. Comparing measurements of $\gamma$ for individual lenses using both techniques, we find a statistically insignificant correlation of $-0.150^{+0.223}_{-0.217}$ between the two, indicating a lack of statistical power or deviations from a power-law density in certain lenses. At fixed surface mass density, we measure a redshift dependence, $\partial\langle\gamma\rangle/\partial z=0.345^{+0.322}_{-0.296}$, that is consistent with traditional techniques for the same sample of SLACS and GALLERY lenses. Interestingly, the consistency breaks down when we measure the dependence of $\gamma$ on the surface mass density of a lens galaxy. We argue that this is tentative evidence for an inflection point in the total-mass density profile at a few times the galaxy effective radius -- breaking the conspiracy., Comment: 14 pages, 11 figures, 5 tables, submitted to MNRAS

Strong gravitational lensing offers a compelling test of the cold dark matter paradigm, as it allows for subhaloes with masses of $\sim10^{9}$ M$_\odot$ and below to be detected. We test commonly-used techniques for detecting subhaloes superposed in images of strongly lensed galaxies. For the lens we take a simulated galaxy in a $\sim10^{13}$ M$_\odot$ halo grown in a high-resolution cosmological hydrodynamical simulation, which we view from two different directions. Though the resolution is high, we note the simulated galaxy still has an artificial core which adds additional complexity to the baryon dominated region. To remove particle noise, we represent the projected galaxy mass distribution by a series of Gaussian profiles which precisely capture the features of the projected galaxy. We first model the lens mass as a (broken) power-law density profile and then search for small haloes. Of the two projections, one has a regular elliptical shape, while the other has distinct deviations from an elliptical shape. For the former, the broken power-law model gives no false positives and correctly recovers the mass of the superposed small halo, but for the latter we find false positives and the inferred halo mass is overestimated by $\sim4-5$ times. We then use a more complex model in which the lens mass is decomposed into stellar and dark matter components. In this case, we show that we can capture the simulated galaxy's complex projected structures and correctly infer the input small halo., Comment: Accepted by MNRAS. Comments welcome!

The distribution of dark and luminous matter can be mapped around galaxies that gravitationally lens background objects into arcs or Einstein rings. New surveys will soon observe hundreds of thousands of galaxy lenses, and current, labour-intensive analysis methods will not scale up to this challenge. We instead develop a fully automatic, Bayesian method which we use to fit a sample of 59 lenses imaged by the Hubble Space Telescope in uniform conditions. We set out to \textit{leave no lens behind} and focus on ways in which automated fits fail in a small handful of lenses, describing adjustments to the pipeline that allows us to infer accurate lens models. Our pipeline ultimately fits {\em all} 59 lenses in our sample, with a high success rate key because catastrophic outliers would bias large samples with small statistical errors. Machine Learning techniques might further improve the two most difficult steps: subtracting foreground lens light and initialising a first, approximate lens model. After that, increasing model complexity is straightforward. We find a mean $\sim1\%$ measurement precision on the measurement of the Einstein radius across the lens sample which {\em does not degrade with redshift} up to at least $z=0.7$ -- in stark contrast to other techniques used to study galaxy evolution, like stellar dynamics. Our \texttt{PyAutoLens} software is open source, and is also installed in the Science Data Centres of the ESA Euclid mission., Comment: 23 pages, 20 figures, 5 tables. Submitted to MNRAS

We present spectroscopic measurements for 71 galaxies associated with 62 of the brightest high-redshift submillimeter sources from the Southern fields of the Herschel Astrophysical Terahertz Large Area Survey (H-ATLAS), while targeting 85 sources which resolved into 142. We have obtained robust redshift measurements for all sources using the 12-m Array and an efficient tuning of ALMA to optimise its use as a redshift hunter, with 73 per cent of the sources having a robust redshift identification. Nine of these redshift identifications also rely on observations from the Atacama Compact Array. The spectroscopic redshifts span a range $1.41

We have carried out the first spatially-resolved investigation of the multi-phase interstellar medium (ISM) at high redshift, using the z=4.24 strongly-lensed sub-millimetre galaxy H-ATLASJ142413.9+022303 (ID141). We present high-resolution (down to ~350 pc) ALMA observations in dust continuum emission and in the CO(7-6), H_2O (2_{1,1} - 2_{0,2}), CI(1-0) and CI(2-1) lines, the latter two allowing us to spatially resolve the cool phase of the ISM for the first time. Our modelling of the kinematics reveals that the system appears to be dominated by a rotationally-supported gas disk with evidence of a nearby perturber. We find that the CI(1-0) line has a very different distribution to the other lines, showing the existence of a reservoir of cool gas that might have been missed in studies of other galaxies. We have estimated the mass of the ISM using four different tracers, always obtaining an estimate in the range (3.2-3.8) x 10^{11} M_sol, significantly higher than our dynamical mass estimate of (0.8-1.3) x 10^{11} M_sol. We suggest that this conflict and other similar conflicts reported in the literature is because the gas-to-tracer ratios are ~4 times lower than the Galactic values used to calibrate the ISM in high-redshift galaxies. We demonstrate that this could result from a top-heavy initial mass function and strong chemical evolution. Using a variety of quantitative indicators, we show that, extreme though it is at z=4.24, ID141 will likely join the population of quiescent galaxies that appears in the Universe at z~3., Comment: This article has been accepted for publication in MNRAS, published by Oxford University Press on behalf of the Royal Astronomical Society. 24 pages

Understanding how activity in neural circuits reshapes following task learning could reveal fundamental mechanisms of learning. Thanks to the recent advances in neural imaging technologies, high-quality recordings can be obtained from hundreds of neurons over multiple days or even weeks. However, the complexity and dimensionality of population responses pose significant challenges for analysis. Existing methods of studying neuronal adaptation and learning often impose strong assumptions on the data or model, resulting in biased descriptions that do not generalize. In this work, we use a variant of deep generative models called - CycleGAN, to learn the unknown mapping between pre- and post-learning neural activities recorded $\textit{in vivo}$. We develop an end-to-end pipeline to preprocess, train and evaluate calcium fluorescence signals, and a procedure to interpret the resulting deep learning models. To assess the validity of our method, we first test our framework on a synthetic dataset with known ground-truth transformation. Subsequently, we applied our method to neural activities recorded from the primary visual cortex of behaving mice, where the mice transition from novice to expert-level performance in a visual-based virtual reality experiment. We evaluate model performance on generated calcium signals and their inferred spike trains. To maximize performance, we derive a novel approach to pre-sort neurons such that convolutional-based networks can take advantage of the spatial information that exists in neural activities. In addition, we incorporate visual explanation methods to improve the interpretability of our work and gain insights into the learning process as manifested in the cellular activities. Together, our results demonstrate that analyzing neuronal learning processes with data-driven deep unsupervised methods holds the potential to unravel changes in an unbiased way.

We present modelling of ~0.1arcsec resolution Atacama Large Millimetre/sub-millimeter Array imaging of seven strong gravitationally lensed galaxies detected by the Herschel Space Observatory. Four of these systems are galaxy-galaxy scale strong lenses, with the remaining three being group-scale lenses. Through careful modelling of visibilities, we infer the mass profiles of the lensing galaxies and by determining the magnification factors, we investigate the intrinsic properties and morphologies of the lensed sub-millimetre sources. We find that these sub-millimetre sources all have ratios of star formation rate to dust mass that is consistent with or in excess of the mean ratio for high-redshift sub-millimetre galaxies and low redshift ultra-luminous infrared galaxies. The contribution to the infrared luminosity from possible AGN is not quantified and so could be biasing our star formation rates to higher values. The majority of our lens models have mass density slopes close to isothermal, but some systems show significant differences., Comment: 12 pages, 5 figures. Submitted to MNRAS

Input pipelines, which ingest and transform input data, are an essential part of training Machine Learning (ML) models. However, it is challenging to implement efficient input pipelines, as it requires reasoning about parallelism, asynchrony, and variability in fine-grained profiling information. Our analysis of over two million ML jobs in Google datacenters reveals that a significant fraction of model training jobs could benefit from faster input data pipelines. At the same time, our analysis indicates that most jobs do not saturate host hardware, pointing in the direction of software-based bottlenecks. Motivated by these findings, we propose Plumber, a tool for finding bottlenecks in ML input pipelines. Plumber uses an extensible and interpretable operational analysis analytical model to automatically tune parallelism, prefetching, and caching under host resource constraints. Across five representative ML pipelines, Plumber obtains speedups of up to 47x for misconfigured pipelines. By automating caching, Plumber obtains end-to-end speedups of over 50% compared to state-of-the-art tuners.

The elliptical power-law (EPL) model of the mass in a galaxy is widely used in strong gravitational lensing analyses. However, the distribution of mass in real galaxies is more complex. We quantify the biases due to this model mismatch by simulating and then analysing mock {\it Hubble Space Telescope} imaging of lenses with mass distributions inferred from SDSS-MaNGA stellar dynamics data. We find accurate recovery of source galaxy morphology, except for a slight tendency to infer sources to be more compact than their true size. The Einstein radius of the lens is also robustly recovered with 0.1% accuracy, as is the global density slope, with 2.5% relative systematic error, compared to the 3.4% intrinsic dispersion. However, asymmetry in real lenses also leads to a spurious fitted `external shear' with typical strength, $\gamma_{\rm ext}=0.015$. Furthermore, time delays inferred from lens modelling without measurements of stellar dynamics are typically underestimated by $\sim$5%. Using such measurements from a sub-sample of 37 lenses would bias measurements of the Hubble constant $H_0$ by $\sim$9%. Although this work is based on a particular set of MaNGA galaxies, and the specific value of the detected biases may change for another set of strong lenses, our results strongly suggest the next generation cosmography needs to use more complex lens mass models., Comment: Accepted by RAA; Fix a few typos, add some references

We rederive the number density of intervening line-of-sight haloes relative to lens subhaloes in galaxy-galaxy strong lensing observations, where these perturbers can generate detectable image fluctuations. Previous studies have calculated the detection limit of a line-of-sight small-mass dark halo by comparing the lensing deflection angles it would cause, to those caused by a subhalo within the lens. However, this overly simplifies the difference in observational consequences between a subhalo and a line-of-sight halo. Furthermore, it does not take into account degeneracies between an extra subhalo and the uncertain properties of the main lens. More in keeping with analyses of real-world observations, we regard a line-of-sight halo as detectable only if adding it to a smooth model generates a statistically significant improvement in the reconstructed image. We find that the number density of detectable line-of-sight perturbers has been overestimated by as much as a factor of two in the previous literature. For typical lensing geometries and configurations, very deep imaging is sensitive to twice as many line-of-sight perturbers as subhaloes, but moderate depth imaging is sensitive to only slightly more line-of-sight perturbers than subhaloes., Comment: Accepted by MNRAS. Comments welcome

A defining prediction of the cold dark matter (CDM) cosmological model is the existence of a very large population of low-mass haloes. This population is absent in models in which the dark matter particle is warm (WDM). These alternatives can, in principle, be distinguished observationally because halos along the line-of-sight can perturb galaxy-galaxy strong gravitational lenses. Furthermore, the WDM particle mass could be deduced because the cut-off in their halo mass function depends on the mass of the particle. We systematically explore the detectability of low-mass haloes in WDM models by simulating and fitting mock lensed images. Contrary to previous studies, we find that halos are harder to detect when they are either behind or in front of the lens. Furthermore, we find that the perturbing effect of haloes increases with their concentration: detectable haloes are systematically high-concentration haloes, and accounting for the scatter in the mass-concentration relation boosts the expected number of detections by as much as an order of magnitude. Haloes have lower concentration for lower particle masses and this further suppresses the number of detectable haloes beyond the reduction arising from the lower halo abundances alone. Taking these effects into account can make lensing constraints on the value of the mass function cut-off at least an order of magnitude more stringent than previously appreciated., Comment: MNRAS submitted. Comments welcome

Strong gravitational lensing, which can make a background source galaxy appears multiple times due to its light rays being deflected by the mass of one or more foreground lens galaxies, provides astronomers with a powerful tool to study dark matter, cosmology and the most distant Universe. PyAutoLens is an open-source Python 3.6+ package for strong gravitational lensing, with core features including fully automated strong lens modeling of galaxies and galaxy clusters, support for direct imaging and interferometer datasets and comprehensive tools for simulating samples of strong lenses. The API allows users to perform ray-tracing by using analytic light and mass profiles to build strong lens systems. Accompanying PyAutoLens is the autolens workspace (see https://github.com/Jammy2211/autolens_workspace), which includes example scripts, lens datasets and the HowToLens lectures in Jupyter notebook format which introduce non experts to strong lensing using PyAutoLens. Readers can try PyAutoLens right now by going to the introduction Jupyter notebook on Binder (see https://mybinder.org/v2/gh/Jammy2211/autolens_workspace/master) or checkout the readthedocs (see https://pyautolens.readthedocs.io/en/latest/) for a complete overview of PyAutoLens's features., Comment: 2 pages, 1 figure

We present an analysis of the spatial clustering of a large sample of high-resolution, interferometically identified, submillimetre galaxies (SMGs). We measure the projected cross-correlation function of ~350 SMGs in the UKIDSS Ultra Deep-Survey Field across a redshift range of $z=1.5-3$ utilising a method that incorporates the uncertainties in the redshift measurements for both the SMGs and cross-correlated galaxies through sampling their full probability distribution functions. By measuring the absolute linear bias of the SMGs we derive halo masses of $\log_{10}(M_{\rm halo}[{h^{-1}\,\rm M_{\odot}}])\sim12.8$ with no evidence of evolution in the halo masses with redshift, contrary to some previous work. From considering models of halo mass growth rates we predict that the SMGs will reside in haloes of mass $\log_{10}(M_{\rm halo}[{h^{-1}\,\rm M_{\odot}}])\sim13.2$ at $z=0$, consistent with the expectation that the majority of $z=1.5-3$ SMGs will evolve into present-day spheroidal galaxies. Finally, comparing to models of stellar-to-halo mass ratios, we show that SMGs may correspond to systems that are maximally efficient at converting their gas reservoirs into stars. We compare them to a simple model for gas cooling in halos that suggests that the unique properties of the SMG population, including their high levels of star-formation and their redshift distribution, are a result of the SMGs being the most massive galaxies that are still able to accrete cool gas from their surrounding intragalactic medium., Comment: 13 pages, 7 figures, submitted to MNRAS

A fundamental prediction of the cold dark matter (CDM) model of structure formation is the existence of a vast population of dark matter haloes extending to subsolar masses. By contrast, other dark matter models, such as a warm thermal relic (WDM), predict a cutoff in the mass function at a mass which, for popular models, lies approximately between $10^7$ and $10^{10}~{\rm M}_\odot$. We use mock observations to demonstrate the viability of a forward modelling approach to extract information about low-mass dark haloes lying along the line-of-sight to galaxy-galaxy strong lenses. This can be used to constrain the mass of a thermal relic dark matter particle, $m_\mathrm{DM}$. With 50 strong lenses at Hubble Space Telescope resolution and a maximum pixel signal-to-noise ratio of $\sim50$, the expected median 2$\sigma$ constraint for a CDM-like model (with a halo mass cutoff at $10^{7}~{\rm M}_\odot$) is $m_\mathrm{DM} > 4.10 \, \mathrm{keV}$ (50% chance of constraining $m_{\rm DM}$ to be better than 4.10 keV). If, however, the dark matter is a warm particle of $m_\mathrm{DM}=2.2 \, \mathrm{keV}$, our 'Approximate Bayesian Computation' method would result in a median estimate of $m_\mathrm{DM}$ between 1.43 and 3.21 keV. Our method can be extended to the large samples of strong lenses that will be observed by future telescopes, and could potentially rule out the standard CDM model of cosmogony. To aid future survey design, we quantify how these constraints will depend on data quality (spatial resolution and integration time) as well as on the lensing geometry (source and lens redshifts)., Comment: Accepted by MNRAS. Comments welcome

Calcium imaging has become a powerful and popular technique to monitor the activity of large populations of neurons in vivo. However, for ethical considerations and despite recent technical developments, recordings are still constrained to a limited number of trials and animals. This limits the amount of data available from individual experiments and hinders the development of analysis techniques and models for more realistic sizes of neuronal populations. The ability to artificially synthesize realistic neuronal calcium signals could greatly alleviate this problem by scaling up the number of trials. Here, we propose a Generative Adversarial Network (GAN) model to generate realistic calcium signals as seen in neuronal somata with calcium imaging. To this end, we propose CalciumGAN, a model based on the WaveGAN architecture and train it on calcium fluorescent signals with the Wasserstein distance. We test the model on artificial data with known ground-truth and show that the distribution of the generated signals closely resembles the underlying data distribution. Then, we train the model on real calcium traces recorded from the primary visual cortex of behaving mice and confirm that the deconvolved spike trains match the statistics of the recorded data. Together, these results demonstrate that our model can successfully generate realistic calcium traces, thereby providing the means to augment existing datasets of neuronal activity for enhanced data exploration and modelling.

Many recent efforts have shown that in-network computing can benefit various datacenter applications. In this paper, we explore a relatively less-explored domain which we argue can benefit from in-network computing: scientific workloads in high-performance computing. By analyzing canonical examples of HPC applications, we observe unique opportunities and challenges for exploiting in-network computing to accelerate scientific workloads. In particular, we find that the dynamic and demanding nature of scientific workloads is the major obstacle to the adoption of in-network approaches which are mostly open-loop and lack runtime feedback. In this paper, we present NSinC (Network-accelerated ScIeNtific Computing), an architecture for fully unleashing the potential benefits of in-network computing for scientific workloads by providing closed-loop runtime feedback to in-network acceleration services. We outline key challenges in realizing this vision and a preliminary design to enable acceleration for scientific applications., Comment: 8 pages, 3 figures

One of the main challenges in current systems neuroscience is the analysis of high-dimensional neuronal and behavioral data that are characterized by different statistics and timescales of the recorded variables. We propose a parametric copula model which separates the statistics of the individual variables from their dependence structure, and escapes the curse of dimensionality by using vine copula constructions. We use a Bayesian framework with Gaussian Process (GP) priors over copula parameters, conditioned on a continuous task-related variable. We validate the model on synthetic data and compare its performance in estimating mutual information against the commonly used non-parametric algorithms. Our model provides accurate information estimates when the dependencies in the data match the parametric copulas used in our framework. When the exact density estimation with a parametric model is not possible, our Copula-GP model is still able to provide reasonable information estimates, close to the ground truth and comparable to those obtained with a neural network estimator. Finally, we apply our framework to real neuronal and behavioral recordings obtained in awake mice. We demonstrate the ability of our framework to 1) produce accurate and interpretable bivariate models for the analysis of inter-neuronal noise correlations or behavioral modulations; 2) expand to more than 100 dimensions and measure information content in the whole-population statistics. These results demonstrate that the Copula-GP framework is particularly useful for the analysis of complex multidimensional relationships between neuronal, sensory and behavioral data.

Verifying that sub-mm galaxies (SMGs) are gravitationally lensed requires time-expensive observations with over-subscribed high-resolution observatories. Here, we aim to strengthen the evidence of gravitational lensing within the Herschel Bright Sources (HerBS) by cross-comparing their positions to optical (SDSS) and near-infrared (VIKING) surveys, in order to search for the foreground lensing galaxy candidates. Resolved observations of the brightest HerBS sources have already shown that most are lensed, and a galaxy evolution model predicts that $\sim$76% of the total HerBS sources are lensed, although with the SDSS survey we are only able to identify the likely foreground lenses for 25% of the sources. With the near-infrared VIKING survey, however, we are able to identify the likely foreground lenses for 57% of the sources, and we estimate that 82% of the HerBS sources have lenses on the VIKING images even if we cannot identify the lens in every case. We find that the angular offsets between lens and Herschel source are larger than that expected if the lensing is done by individual galaxies. We also find that the fraction of HerBS sources that are lensed falls with decreasing 500-micron flux density, which is expected from the galaxy evolution model. Finally, we apply our statistical VIKING cross-identification to the entire Herschel-ATLAS catalogue, where we also find that the number of lensed sources falls with decreasing 500-micron flux density., Comment: 18 pages, 15 figures, Accepted for MNRAS, 12 additional figures can be found in ArXiv source

Deep learning accelerators efficiently train over vast and growing amounts of data, placing a newfound burden on commodity networks and storage devices. A common approach to conserve bandwidth involves resizing or compressing data prior to training. We introduce Progressive Compressed Records (PCRs), a data format that uses compression to reduce the overhead of fetching and transporting data, effectively reducing the training time required to achieve a target accuracy. PCRs deviate from previous storage formats by combining progressive compression with an efficient storage layout to view a single dataset at multiple fidelities---all without adding to the total dataset size. We implement PCRs and evaluate them on a range of datasets, training tasks, and hardware architectures. Our work shows that: (i) the amount of compression a dataset can tolerate exceeds 50% of the original encoding for many DL training tasks; (ii) it is possible to automatically and efficiently select appropriate compression levels for a given task; and (iii) PCRs enable tasks to readily access compressed data at runtime---utilizing as little as half the training bandwidth and thus potentially doubling training speed.

We present measurements of the angular correlation function of sub-millimeter (sub-mm) galaxies (SMGs) identified in four out of the five fields of the Herschel Astrophysical Terahertz Large Area Survey (H-ATLAS) - GAMA-9h, GAMA-12h, GAMA-15h and NGP - with flux densities $S_{250\mu m}$>30 mJy at 250 {\mu}m. We show that galaxies selected at this wavelength trace the underlying matter distribution differently at low and high redshifts. We study the evolution of the clustering finding that at low redshifts sub-mm galaxies exhibit clustering strengths of $r_0$ $\sim$ 2 - 3 $h^{-1}$ Mpc, below z < 0.3. At high redshifts, on the other hand, we find that sub-mm galaxies are more strongly clustered with correlation lengths $r_0$ = 8.1 $\pm$ 0.5, 8.8 $\pm$ 0.8 and 13.9 $\pm$ 3.9 $h^{-1}$Mpc at z = 1 - 2, 2 - 3 and 3 - 5, respectively. We show that sub-mm galaxies across the redshift range 1 < z < 5, typically reside in dark-matter halos of mass of the order of ~ $10^{12.5}$ - $10^{13.0}$ $h^{-1} \, M_{\odot}$ and are consistent with being the progenitors of local massive elliptical galaxies that we see in the local Universe., Comment: 17 pages, 11 figures, 3 tables. Accepted for publication in MNRAS

With the advent of wide-area submillimeter surveys, a large number of high-redshift gravitationally lensed dusty star-forming galaxies (DSFGs) has been revealed. Due to the simplicity of the selection criteria for candidate lensed sources in such surveys, identified as those with $S_{500\mu m} > 100$ mJy, uncertainties associated with the modelling of the selection function are expunged. The combination of these attributes makes submillimeter surveys ideal for the study of strong lens statistics. We carried out a pilot study of the lensing statistics of submillimetre-selected sources by making observations with the Atacama Large Millimetre Array (ALMA) of a sample of strongly-lensed sources selected from surveys carried out with the Herschel Space Observatory. We attempted to reproduce the distribution of image separations for the lensed sources using a halo mass function taken from a numerical simulation which contains both dark matter and baryons. We used three different density distributions, one based on analytical fits to the halos formed in the EAGLE simulation and two density distributions (Singular Isothermal Sphere (SIS) and SISSA) that have been used before in lensing studies. We found that we could reproduce the observed distribution with all three density distributions, as long as we imposed an upper mass transition of $\sim$$10^{13} M_{\odot}$ for the SIS and SISSA models, above which we assumed that the density distribution could be represented by an NFW profile. We show that we would need a sample of $\sim$500 lensed sources to distinguish between the density distributions, which is practical given the predicted number of lensed sources in the Herschel surveys., Comment: 14 pages, 7 figures, accepted for publication in MNRAS