Search

In this study, we train score-based diffusion models to super-resolve gigaparsec-scale cosmological simulations of the 21-cm signal. We examine the impact of network and training dataset size on model performance, demonstrating that a single simulation is sufficient for a model to learn the super-resolution task regardless of the initial conditions. Our best-performing model achieves pixelwise $\mathrm{RMSE}\sim0.57\ \mathrm{mK}$ and dimensionless power spectrum residuals ranging from $10^{-2}-10^{-1}\ \mathrm{mK^2}$ for $128^3$, $256^3$ and $512^3$ voxel simulation volumes at redshift $10$. The super-resolution network ultimately allows us to utilize all spatial scales covered by the SKA1-Low instrument, and could in future be employed to help constrain the astrophysics of the early Universe., Comment: 10 pages, 2 figures, accepted submission for the Machine Learning and the Physical Sciences Workshop at the 38th conference on Neural Information Processing Systems (NeurIPS), OpenReview link: https://openreview.net/forum?id=QGgeqMV8Er

Due to the large dynamic ranges involved with separating the cosmological 21-cm signal from the Cosmic Dawn from galactic foregrounds, a well-calibrated instrument is essential to avoid biases from instrumental systematics. In this paper we present three methods for calibrating a global 21-cm cosmology experiment using the noise wave parameter formalisation to characterise a low noise amplifier including a careful consideration of how calibrator temperature noise and singularities will bias the result. The first method presented in this paper builds upon the existing conjugate priors method by weighting the calibrators by a physically motivated factor, thereby avoiding singularities and normalising the noise. The second method fits polynomials to the noise wave parameters by marginalising over the polynomial coefficients and sampling the polynomial orders as parameters. The third method introduces a physically motivated noise model to the marginalised polynomial method. Running these methods on a suite of simulated datasets based on the REACH receiver design and a lab dataset, we found that our methods produced a calibration solution which is equally as or more accurate than the existing conjugate priors method when compared with an analytic estimate of the calibrator's noise. We find in the case of the measured lab dataset the conjugate priors method is biased heavily by the large noise on the shorted load calibrator, resulting in incorrect noise wave parameter fits. This is mitigated by the methods introduced in this paper which calibrate the validation source spectra to within 5% of the noise floor., Comment: 9 pages, 5 figures

The Hydrogen Intensity and Real-time Analysis eXperiment (HIRAX) is an upcoming radio interferometric telescope designed to constrain dark energy through the 21cm intensity mapping of Baryon Acoustic Oscillations (BAO). Instrumental systematics must be controlled and carefully characterized to measure the 21cm power spectrum with fidelity and achieve high-precision constraints on the cosmological parameters. The chromaticity of the primary beam is one such complicated systematic, which can leak the power of spectrally smooth foregrounds beyond the ideal horizon limits due to the complex spatial and spectral structures of the sidelobes and the mainlobe. This paper studies the chromaticity of the HIRAX Stokes I primary beam and its effects on accurate measurements of the 21cm power spectrum. To investigate the effect of chromaticity in the 21cm power spectrum, we present a physically motivated beam modeling technique, which uses a flexible basis derived from traditional optics that can account for higher-order radial and azimuthal structures in the primary beam. We investigate the impact of imperfect knowledge of the mainlobe and sidelobes chromaticity in the power spectrum space by subtracting a simple foreground model in simulated snapshot visibilities to recover the H$\textsc{i}$ power spectrum. Additionally, we find that modeling up to the octupolar azimuthal order feature (fourth-order angular variation) in the primary beam is sufficient to reduce the leakage outside the wedge with minimal bias., Comment: 20 pages, 12 figures. Prepared for submitting in the Astrophysical Journal (ApJ)

The precise measurement of the sky-averaged HI absorption signal between 50 and 200 MHz is the primary goal of global 21-cm cosmology. This measurement has the potential to unravel the underlying physics of cosmic structure formation and evolution during the Cosmic Dawn. It is, however, hindered by various non-smooth, frequency-dependent effects, whose structures resemble those of the signal. One such effect is the leakage of polarised foregrounds into the measured intensity signal: polarised foreground emission undergoes Faraday rotation as it passes through the magnetic fields of the interstellar medium, imprinting a chromatic structure in the relevant frequency range which complicates the extraction of the cosmological HI absorption feature. We investigate the effect of polarised Galactic foregrounds on extracting the global 21-cm signal from simulated data using REACH's data analysis pipeline; the Radio Experiment for the Analysis of Cosmic Hydrogen (REACH) is an experiment designed to detect the sky-averaged 21-cm HI signal from the early Universe using physically informed models. Using the REACH pipeline, we successfully recover an injected global 21-cm signal with an amplitude of approximately 0.16 K, centred between 80 and 120 MHz, achieving a low root-mean-square error (less than 30\% of the injected signal strength) in all the tested cases. This includes scenarios with simulated polarised Galactic diffuse emissions and polarised point source emissions, provided the overall polarisation fraction is below $\sim 3\%$. The linear mixing of contamination, caused by the superposition of multiple patches with varying strengths of Faraday rotation, produces patterns that are more distinct from the global signal. This distinction makes global signal recovery easier compared to contamination resulting from a single, slow oscillation pattern., Comment: 11 pages, 9 figures

We investigate the impact of Mutual Coupling (MC) between antennas on the time-delay power spectrum response of the core of the SKA-Low radio telescope. Using two in-house tools - Fast Array Simulation Tool (FAST) (a fast full-wave electromagnetic solver) and OSKAR (a GPU-accelerated radio telescope simulator) - we simulate station beams and compute visibilities for various array layouts (regular, sunflower, and random). Simulations are conducted in an Epoch of Reionisation subband between 120-150~MHz, with a fine frequency resolution of 100~kHz, enabling the investigation of longer delays. Our results show that MC effects significantly increase foreground leakage into longer delays, especially for regular station layouts. For 21-cm science, foreground spill-over into the 21-cm window extends beyond $k_{\parallel} \sim 2$~h$^{-1}$Mpc for all station layouts and across all $k_{\perp}$ modes, completely obscuring the detection window. We find that attempting to remove the foreground contribution from the visibilities using an approximated beam model, based on the average embedded element pattern or interpolating the embedded element patterns from a coarse channel rate of 781~kHz, results in residuals around 1% ($\sim 10^{11}~\mathrm{mK}^2$h$^{-3}\mathrm{Mpc}^3$) which is still around 7 orders of magnitude brighter than the expected level of the EoR signal ($\sim 10^{4}~\mathrm{mK}^2$h$^{-3}\mathrm{Mpc}^3$). We also find that station beam models with at least 4-5 significant digits in the far-field pattern and high spectral resolution are needed for effective foreground removal. Our research provides critical insights into the role of MC in SKA-Low experiments and highlights the computational challenges of fully integrating array patterns that account for MC effects into processing pipelines., Comment: 18 pages, 17 figures

A successful detection of the cosmological 21-cm signal from intensity mapping experiments (for example, during the Epoch of Reioinization or Cosmic Dawn) is contingent on the suppression of subtle systematic effects in the data. Some of these systematic effects, with mutual coupling a major concern in interferometric data, manifest with temporal variability distinct from that of the cosmological signal. Fringe-rate filtering -- a time-based Fourier filtering technique -- is a powerful tool for mitigating these effects; however, fringe-rate filters also attenuate the cosmological signal. Analyses that employ fringe-rate filters must therefore be supplemented by careful accounting of the signal loss incurred by the filters. In this paper, we present a generalized formalism for characterizing how the cosmological 21-cm signal is attenuated by linear time-based filters applied to interferometric visibilities from drift-scanning telescopes. Our formalism primarily relies on analytic calculations and therefore has a greatly reduced computational cost relative to traditional Monte Carlo signal loss analyses. We apply our signal loss formalism to a filtering strategy used by the Hydrogen Epoch of Reionization Array (HERA) and compare our analytic predictions against signal loss estimates obtained through a Monte Carlo analysis. We find excellent agreement between the analytic predictions and Monte Carlo estimates and therefore conclude that HERA, as well as any other drift-scanning interferometric experiment, should use our signal loss formalism when applying linear, time-based filters to the visibilities., Comment: 27 pages, 11 figures, submitted to ApJ

We present a numerical method for the analysis of mutual coupling effects in large, dense and irregular arrays with identical antennas. Building on the Method of Moments (MoM), our technique employs a Macro Basis Function (MBF) approach for rapid direct inversion of the MoM impedance matrix. To expedite the reduced matrix filling, we propose an extension of the Steepest-Descent Multipole expansion which remains numerically stable and efficient across a wide bandwidth. This broadband multipole-based approach is well suited to quasi-planar problems and requires only the pre-computation of each MBF's complex patterns, resulting in low antenna-dependent pre-processing costs. The method also supports arrays with arbitrarily rotated antennas at low additional cost. A simulation of all embedded element patterns of irregular arrays of 256 complex log-periodic antennas completes in just 10 minutes per frequency point on a current laptop, with an additional minute per new layout.

The redshifted 21 cm line of cosmic atomic hydrogen is one of the most auspicious tools in deciphering the early Universe. Recovering this signal remains an ongoing problem for cosmologists in the field, with the signal being hidden behind foregrounds approximately five orders of magnitude brighter than itself. A traditional forward modelling data analysis pipeline using Bayesian data analysis and a physically motivated foreground model to find this signal shows great promise in the case of unchanging environmental conditions. However we demonstrate in this paper that in the presence of a soil with changing dielectric properties under the antenna over time, or a changing soil temperature in the far field of our observation these traditional methods struggle. In this paper we detail a tool using Masked Auto-regressive Flows that improves upon previous physically motivated foreground models when one is trying to recover this signal in the presence of changing environmental conditions. We demonstrate that with these changing parameters our tool consistently recovers the signal with a much greater Bayesian evidence than the traditional data analysis pipeline, decreasing the root mean square error in the recovery of the injected signal by up to 45 %., Comment: 12 Pages, 8 Figures

Contribution of resolved and unresolved extragalactic point sources to the low-frequency sky spectrum is a potentially non-negligible part of the astrophysical foregrounds for cosmic dawn 21-cm experiments. The clustering of such point sources on the sky, combined with the frequency-dependence of the antenna beam, can also make this contribution chromatic. By combining low-frequency measurements of the luminosity function and the angular correlation function of extragalactic point sources, we develop a model for the contribution of these sources to the low-frequency sky spectrum. Using this model, we find that the contribution of sources with flux density $>10^{-6}\,$Jy to the sky-averaged spectrum is smooth and of the order of a few kelvins at 50--$200\,$MHz. We combine this model with measurements of the galactic foreground spectrum and weigh the resultant sky by the beam directivity of the conical log-spiral antenna planned as part of the Radio Experiment for the Analysis of Cosmic Hydrogen (REACH) project. We find that the contribution of point sources to the resultant spectrum is $\sim0.4\%$ of the total foregrounds, but still larger by at least an order of magnitude than the standard predictions for the cosmological 21-cm signal. As a result, not accounting for the point-source contribution leads to a systematic bias in 21-cm signal recovery. We show, however, that in the REACH case, this reconstruction bias can be removed by modelling the point-source contribution as a power law with a running spectral index. We make our code publicly available as a Python package labelled epspy., Comment: Published in MNRAS

The cosmic Dark Ages represent a pivotal epoch in the evolution of the Universe, marked by the emergence of the first cosmic structures under the influence of dark matter. The 21-cm hydrogen line, emanating from the hyperfine transition of neutral hydrogen, serves as a critical probe into this era. We describe the development and implementation of the spectrometer for CosmoCube, a novel lunar orbiting CubeSat designed to detect the redshifted 21-cm signal within the redshift range of 13 to 150. Our instrumentation utilizes a Xilinx RFSoC, which integrates both Analog-to-Digital Converters (ADCs) and Digital-to-Analog Converters (DACs), tailored for the spectrometer component of the radiometer. This system is characterized by a 4096 FFT length at 62.5 kHz steps using a Polyphase Filter Bank (PFB), achieving an average Effective Number of Bits (ENOB) of 11.5 bits throughout the frequency of interest, from 10 MHz to 100 MHz. The spectrometer design is further refined through loopback tests involving both DAC and ADC of the RFSoC, with DAC outputs varying between high (+1 dBm) and low (-3 dBm) power modes to characterize system performance. The power consumption was optimized to 5.45 W using three ADCs and one DAC for the radiometer. Additionally, the stability of the ADC noise floor was investigated in a thermal chamber with environmental temperatures ranging from 5{\deg}C to 40{\deg}C. A consistent noise floor of approximately -152.5 dBFS/Hz was measured, with a variation of $\pm$0.2 dB, ensuring robust performance under varying thermal conditions., Comment: 13 pages, 14 figures

The redshifted 21 cm line signal is a powerful probe of the cosmic dawn and the epoch of reionization. The global spectrum can potentially be detected with a single antenna and spectrometer. However, this measurement requires an extremely accurate calibration of the instrument to facilitate the separation of the 21 cm signal from the much brighter foregrounds and possible variations in the instrument response. Understanding how the measurement errors propagate in a realistic instrument system and affect system calibration is the focus of this work. We simulate a 21 cm global spectrum observation based on the noise wave calibration scheme. We focus on how measurement errors in reflection coefficients affect the noise temperature and how typical errors impact the recovery of the 21 cm signal, especially in the frequency domain. Results show that for our example set up, a typical vector network analyzer (VNA) measurement error in the magnitude of the reflection coefficients of the antenna, receiver, and open cable, which are 0.001, 0.001, and 0.002 (linear), respectively, would result in a 200 mK deviation on the detected signal, and a typical measurement error of 0.48 degree, 0.78 degree, or 0.15 degree in the respective phases would cause a 40 mK deviation. The VNA measurement error can greatly affect the result of a 21 cm global spectrum experiment using this calibration technique, and such a feature could be mistaken for or be combined with the 21 cm signal, Comment: 29 pages, 20 figures

The redshifted 21-cm signal from the Cosmic Dawn and Epoch of Reionization carries invaluable information about the cosmology and astrophysics of the early Universe. Analyzing the data from a sky-averaged 21-cm signal experiment typically involves navigating through an intricate parameter space to accurately address various factors such as foregrounds, beam uncertainties, ionospheric distortions, and receiver noise for the search of the cosmological 21-cm signal. The traditional likelihood-based sampling methods for modeling these effects could become computationally demanding for such highly complex models, which makes it infeasible to include physically motivated 21-cm signal models in the analysis. Moreover, the inference with these traditional methods is driven by the assumed functional form of the likelihood function. This work demonstrates how Simulation-Based Inference through Truncated Marginal Neural Ratio Estimation (TMNRE) can naturally handle these issues at a significantly reduced computational cost than the likelihood-based methods. We estimate the posterior distribution on our model parameters with TMNRE for simulated mock observations, composed of beam-weighted foregrounds, physically motivated 21-cm signal, and radiometric noise. We find that maximizing the information content by simultaneously analyzing the data from multiple time slices and antennas significantly improves the parameter constraints and leads to a better exploration of the cosmological signal. We discuss the application of TMNRE for the current configuration of the REACH experiment and demonstrate how it can be utilized to explore potential avenues for REACH. The method presented here can be easily generalized for any sky-averaged 21-cm signal experiment., Comment: 13 pages, 10 figures

Accurate modelling of the primary beam is an important but difficult task in radio astronomy. For high dynamic range problems such as 21cm intensity mapping, small modelling errors in the sidelobes and spectral structure of the beams can translate into significant systematic errors. Realistic beams exhibit complex spatial and spectral structure, presenting a major challenge for beam measurement and calibration methods. In this paper series, we present a Bayesian framework to infer per-element beam patterns from the interferometric visibilities for large arrays with complex beam structure, assuming a particular (but potentially uncertain) sky model and calibration solution. In this first paper, we develop a compact basis for the beam so that the Bayesian computation is tractable with high-dimensional sampling methods. We use the Hydrogen Epoch of Reionization Array (HERA) as an example, verifying that the basis is capable of describing its single-element E-field beam (i.e. without considering array effects like mutual coupling) with a relatively small number of coefficients. We find that 32 coefficients per feed, incident polarization, and frequency, are sufficient to give percent-level and $\sim$10\% errors in the mainlobe and sidelobes respectively for the current HERA Vivaldi feeds, improving to $\sim 0.1\%$ and $\sim 1\%$ for 128 coefficients.

Radio interferometers targeting the 21cm brightness temperature fluctuations at high redshift are subject to systematic effects that operate over a range of different timescales. These can be isolated by designing appropriate Fourier filters that operate in fringe-rate (FR) space, the Fourier pair of local sidereal time (LST). Applications of FR filtering include separating effects that are correlated with the rotating sky vs. those relative to the ground, down-weighting emission in the primary beam sidelobes, and suppressing noise. FR filtering causes the noise contributions to the visibility data to become correlated in time however, making interpretation of subsequent averaging and error estimation steps more subtle. In this paper, we describe fringe rate filters that are implemented using discrete prolate spheroidal sequences, and designed for two different purposes -- beam sidelobe/horizon suppression (the `mainlobe' filter), and ground-locked systematics removal (the `notch' filter). We apply these to simulated data, and study how their properties affect visibilities and power spectra generated from the simulations. Included is an introduction to fringe-rate filtering and a demonstration of fringe-rate filters applied to simple situations to aid understanding., Comment: 21 pages, 18 figures, submitted to Monthly Notices of the Royal Astronomical Society

The Cosmic Dawn was marked by the formation of the first stars, and preceded the Epoch of Reionization (EoR), when the Universe underwent a fundamental transformation caused by the radiation from these first stars and galaxies. Interferometric 21-cm experiments aim to probe redshifted neutral hydrogen signals from these periods, constraining the conditions of the early Universe. The SKA-Low instrument of the Square Kilometre Array (SKA) is envisaged to be the largest and most sensitive radio telescope at metre and centimetre wavelengths. The latest Aperture Array Verification Systems feature 7-m coaxial transmission lines connecting the low noise amplifiers to optical transmitters at the front of the analogue-receiving chain. An impedance mismatch between these components results in a partially reflected electromagnetic signal, introducing chromatic aberrations into the instrument bandpass. This causes power from the foreground signals to appear at higher delays, potentially contaminating the 'EoR window', a region in which the 21-cm signal should be detectable. We present an end-to-end simulation pipeline for SKA-Low using a composite sky model combining radio foregrounds from the Galactic and Extragalactic All-Sky MWA (GLEAM) Survey, Haslam $408\,$MHz, and a 1.5-cGpc 21-cm brightness temperature cube generated with the 21cmSPACE simulator. We derive a model for the scattering parameters of a coaxial transmission line in terms of its specifications and bulk material properties. Assuming identical cables of length $\leq 15.0\,$m with impedance mismatch $\leq 10\, \Omega$, the reflection is confined below the EoR window. However, we demonstrate that even a 0.1 per cent length tolerance introduces contamination with an absolute fractional difference of $\sim 10$ per cent across all accessible k-modes., Comment: 17 pages, 12 figures

This paper presents the design and deployment of the Hydrogen Epoch of Reionization Array (HERA) phase II system. HERA is designed as a staged experiment targeting 21 cm emission measurements of the Epoch of Reionization. First results from the phase I array are published as of early 2022, and deployment of the phase II system is nearing completion. We describe the design of the phase II system and discuss progress on commissioning and future upgrades. As HERA is a designated Square Kilometer Array (SKA) pathfinder instrument, we also show a number of "case studies" that investigate systematics seen while commissioning the phase II system, which may be of use in the design and operation of future arrays. Common pathologies are likely to manifest in similar ways across instruments, and many of these sources of contamination can be mitigated once the source is identified.

Detection of the faint 21 cm line emission from the Cosmic Dawn and Epoch of Reionisation will require not only exquisite control over instrumental calibration and systematics to achieve the necessary dynamic range of observations but also validation of analysis techniques to demonstrate their statistical properties and signal loss characteristics. A key ingredient in achieving this is the ability to perform high-fidelity simulations of the kinds of data that are produced by the large, many-element, radio interferometric arrays that have been purpose-built for these studies. The large scale of these arrays presents a computational challenge, as one must simulate a detailed sky and instrumental model across many hundreds of frequency channels, thousands of time samples, and tens of thousands of baselines for arrays with hundreds of antennas. In this paper, we present a fast matrix-based method for simulating radio interferometric measurements (visibilities) at the necessary scale. We achieve this through judicious use of primary beam interpolation, fast approximations for coordinate transforms, and a vectorised outer product to expand per-antenna quantities to per-baseline visibilities, coupled with standard parallelisation techniques. We validate the results of this method, implemented in the publicly-available matvis code, against a high-precision reference simulator, and explore its computational scaling on a variety of problems., Comment: 24 pages, 10 figures, accepted to RAS Techniques and Instruments, matvis is publicly available at https://github.com/HERA-Team/matvis

Observations with radio arrays that target the 21-cm signal originating from the early Universe suffer from a variety of systematic effects. An important class of these are reflections and spurious couplings between antennas. We apply a Hamiltonian Monte Carlo sampler to the modelling and mitigation of these systematics in simulated Hydrogen Epoch of Reionisation Array (HERA) data. This method allows us to form statistical uncertainty estimates for both our models and the recovered visibilities, which is an important ingredient in establishing robust upper limits on the Epoch of Reionisation (EoR) power spectrum. In cases where the noise is large compared to the EoR signal, this approach can constrain the systematics well enough to mitigate them down to the noise level for both systematics studied. Where the noise is smaller than the EoR, our modelling can mitigate the majority of the reflections with there being only a minor level of residual systematics, while cross-coupling sees essentially complete mitigation. Our approach performs similarly to existing filtering/fitting techniques used in the HERA pipeline, but with the added benefit of rigorously propagating uncertainties. In all cases it does not significantly attenuate the underlying signal., Comment: 19 pages, 14 figures, submitted to MNRAS

Global 21-cm experiments are built to study the evolution of the Universe between the cosmic dawn and the epoch of reionisation. FlexKnot is a function parameterised by freely moving knots stringed together by splines. Adopting the FlexKnot function as the signal model has the potential to separate the global 21-cm signal from the foregrounds and systematics while being capable of recovering the crucial features given by theoretical predictions. In this paper, we implement the FlexKnot method by integrating twice over a function of freely moving knots interpolated linearly. The function is also constrained at the lower frequencies corresponding to the dark ages by theoretical values. The FlexKnot model is tested in the framework of the realistic data analysis pipeline of the REACH global signal experiment using simulated antenna temperature data. We demonstrate that the FlexKnot model performs better than existing signal models, e.g. the Gaussian signal model, at reconstructing the shape of the true signals present in the simulated REACH data, especially for injected signals with complex structures. The capabilities of the FlexKnot signal model is also tested by introducing various systematics and simulated global signals of different types. These tests show that four to five knots are sufficient to recover the general shape of most realistic injected signals, with or without sinusoidal systematics. We show that true signals whose absorption trough of amplitude between 120 to 450 mK can be well recovered with systematics up to about 50 mK., Comment: 12 pages, 11 figures

The key to detecting neutral hydrogen during the epoch of reionization (EoR) is to separate the cosmological signal from the dominating foreground radiation. We developed direct optimal mapping (DOM) to map interferometric visibilities; it contains only linear operations, with full knowledge of point spread functions from visibilities to images. Here, we demonstrate a fast Fourier transform-based image power spectrum and its window functions computed from the DOM images. We use noiseless simulation, based on the Hydrogen Epoch of Reionization Array Phase I configuration, to study the image power spectrum properties. The window functions show $<10^{-11}$ of the integrated power leaks from the foreground-dominated region into the EoR window; the 2D and 1D power spectra also verify the separation between the foregrounds and the EoR., Comment: Published in ApJ

Experimental 21 cm cosmology aims to detect the formation of the first stars during the cosmic dawn and the subsequent epoch of reionization by utilizing the 21 cm hydrogen line transition. While several experiments have published results that begin to constrain the shape of this signal, a definitive detection has yet to be achieved. In this paper, we investigate the influence of uncertain antenna-sky interactions on the possibility of detecting the signal. This paper aims to define the level of accuracy to which a simulated antenna beam pattern is required to agree with the actual observing beam pattern of the antenna to allow for a confident detection of the global 21 cm signal. By utilising singular value decomposition, we construct a set of antenna power patterns that incorporate minor, physically motivated variations. We take the absolute mean averaged difference between the original beam and the perturbed beam averaged over frequency ($\Delta D$) to quantifying this difference, identifying the correlation between $\Delta D$ and antenna temperature. To analyse the impact of $\Delta D$ on making a confident detection, we utilize the REACH Bayesian analysis pipeline and compare the Bayesian evidence $\log \mathcal{Z}$ and root-mean-square error for antenna beams of different $\Delta D$ values. Our calculations suggest that achieving an agreement between the original and perturbed antenna power pattern with $\Delta D$ better than -35 dB is necessary for confident detection of the global 21 cm signal. Furthermore, we discuss potential methods to achieve the required high level of accuracy within a global 21~cm experiment.

Radio observations of the neutral hydrogen signal from the Cosmic Dawn and Epoch of Reionisation have helped to provide constraints on the properties of the first stars and galaxies. Since this global 21-cm cosmological signal from the Cosmic Dawn is effectively constant on observing timescales and since effects resulting from systematics will vary with time, the effects of these systematics can be mitigated without the need for a model of the systematic. We present a method to account for unmodelled time-varying systematics in 21-cm radio cosmology experiments using a squared-exponential Gaussian process kernel to account for correlations between time bins in a fully Bayesian way. We find by varying the model parameters of a simulated systematic that the Gaussian process method improves our ability to recover the signal parameters by widening the posterior in the presence of a systematic and reducing the bias in the mean fit parameters. When varying the amplitude of a model sinusoidal systematic between 0.25 and 2.00 times the 21-cm signal amplitude and the period between 0.5 and 4.0 times the signal width, we find on average a 5% improvement in the root mean squared error of the fitted signal. We can use the fitted Gaussian process hyperparameters to identify the presence of a systematic in the data, demonstrating the method's utility as a diagnostic tool. Furthermore, we can use Gaussian process regression to calculate a mean fit to the residuals over time, providing a basis for producing a model of the time-varying systematic., Comment: 11 pages, 13 figures

One key challenge in detecting 21 cm cosmological signal at z > 6 is to separate the cosmological signal from foreground emission. This can be studied in a power spectrum space where the foreground is confined to low delay modes whereas the cosmological signal can spread out to high delay modes. When there is a calibration error, however, chromaticity of gain errors propagates to the power spectrum estimate and contaminates the modes for cosmological detection. The Hydrogen Epoch of Reionization Array (HERA) employs a high-precision calibration scheme using redundancy in measurements. In this study, we focus on the gain errors induced by nonredundancies arising from feed offset relative to the HERA's 14 meter parabolic dish element, and investigate how to mitigate the chromatic gain errors using three different methods: restricting baseline lengths for calibration, smoothing the antenna gains, and applying a temporal filter prior to calibration. With 2 cm/2 degree perturbations for translation/tilting motions, a level achievable under normal HERA operating conditions, the combination of the baseline cut and temporal filtering indicates that the spurious gain feature due to nonredundancies is significantly reduced, and the power spectrum recovers the clean foreground-free region. We found that the mitigation technique works even for large feed motions but in order to keep a stable calibration process, the feed positions need to be constrained to 2 cm for translation motions and 2 degree for tilting offset relative to the dish's vertex., Comment: Accepted for publication in ApJ

The 21 cm signal from cosmic hydrogen is one of the most propitious probes of the early Universe. The detection of this signal would reveal key information about the first stars, the nature of dark matter, and early structure formation. We explore the impact of an emissive and reflective, or `hot', horizon on the recovery of this signal for global 21 cm experiments. It is demonstrated that using physically motivated foreground models to recover the sky-averaged 21 cm signal one must accurately describe the horizon around the radiometer. We show that not accounting for the horizon will lead to a signal recovery with residuals an order of magnitude larger than the injected signal, with a log Bayesian evidence of almost 1600 lower than when one does account for the horizon. It is shown that signal recovery is sensitive to incorrect values of soil temperature and reflection coefficient in describing the horizon, with even a 10% error in reflectance causing twofold increases in the RMSE of a given fit. We also show these parameters may be fitted using Bayesian inference to mitigate for these issues without overfitting and mischaracterising a non-detection. We further demonstrate that signal recovery is sensitive to errors in measurements of the horizon projection onto the sky, but fitting for soil temperature and reflection coefficients with priors that extend beyond physical expectation can resolve these problems. We show that using an expanded prior range can reliably recover the signal even when the height of the horizon is mismeasured by up to 20%, decreasing the RMSE from the model that does not perform this fitting by a factor of 9., Comment: 12 pages, 11 figures, 5 tables

Radio interferometers aiming to measure the power spectrum of the redshifted 21 cm line during the Epoch of Reionisation (EoR) need to achieve an unprecedented dynamic range to separate the weak signal from overwhelming foreground emissions. Calibration inaccuracies can compromise the sensitivity of these measurements to the effect that a detection of the EoR is precluded. An alternative to standard analysis techniques makes use of the closure phase, which allows one to bypass antenna-based direction-independent calibration. Similarly to standard approaches, we use a delay spectrum technique to search for the EoR signal. Using 94 nights of data observed with Phase I of the Hydrogen Epoch of Reionization Array (HERA), we place approximate constraints on the 21 cm power spectrum at $z=7.7$. We find at 95% confidence that the 21 cm EoR brightness temperature is $\le$(372)$^2$ "pseudo" mK$^2$ at 1.14 "pseudo" $h$ Mpc$^{-1}$, where the "pseudo" emphasises that these limits are to be interpreted as approximations to the actual distance scales and brightness temperatures. Using a fiducial EoR model, we demonstrate the feasibility of detecting the EoR with the full array. Compared to standard methods, the closure phase processing is relatively simple, thereby providing an important independent check on results derived using visibility intensities, or related., Comment: 16 pages, 14 figures, accepted for publication by MNRAS

Precision antenna calibration is required for mitigating the impact of foreground contamination in 21 cm cosmological radio surveys. One widely studied source of error is the effect of missing point sources in the calibration sky model; however, poorly understood diffuse galactic emission also creates a calibration bias that can complicate the clean separation of foregrounds from the 21 cm signal. In this work, we present a technique for suppressing this bias with temporal filtering of radio interferometric visibilities observed in a drift-scan mode. We demonstrate this technique on mock simulations of the Hydrogen Epoch of Reionization Array (HERA) experiment. Inspecting the recovered calibration solutions, we find that our technique reduces spurious errors by over an order of magnitude. This improved accuracy approaches the required accuracy needed to make a fiducial detection of the 21 cm signal with HERA, but is dependent on a number of external factors that we discuss. We also explore different types of temporal filtering techniques and discuss their relative performance and tradeoffs.

The first billion years of cosmic history remains largely unobserved. We demonstrate, using a novel machine learning technique, how combining upper limits on the spatial fluctuations in the 21-cm signal with observations of the sky-averaged 21-cm signal from neutral hydrogen can improve our understanding of this epoch. By jointly analysing data from SARAS3 (redshift $z\approx15-25$) and limits from HERA ($z\approx8$ and $10$), we show that such a synergetic analysis provides tighter constraints on the astrophysics of galaxies 200 million years after the Big Bang than can be achieved with the individual data sets. Although our constraints are weak, this is the first time data from a sky-averaged 21-cm experiment and power spectrum experiment have been analysed together. In synergy, the two experiments leave only $64.9^{+0.3}_{-0.1}$% of the explored broad theoretical parameter space to be consistent with the joint data set, in comparison to $92.3^{+0.3}_{-0.1}$% for SARAS3 and $79.0^{+0.5}_{-0.2}$% for HERA alone. We use the joint analysis to constrain star formation efficiency, minimum halo mass for star formation, X-ray luminosity of early emitters and the radio luminosity of early galaxies. The joint analysis disfavours at 68% confidence a combination of galaxies with X-ray emission that is $\lesssim 33$ and radio emission that is $\gtrsim 32$ times as efficient as present day galaxies. We disfavour at $95$% confidence scenarios in which power spectra are $\geq126$ mK$^{2}$ at $z=25$ and the sky-averaged signals are $\leq-277$ mK., Comment: Accepted for MNRAS

In a sky-averaged 21-cm signal experiment, the uncertainty on the extracted signal depends mainly on the covariance between the foreground and 21-cm signal models. In this paper, we construct these models using the modes of variation obtained from the Singular Value Decomposition of a set of simulated foreground and 21-cm signals. We present a strategy to reduce this overlap between the 21-cm and foreground modes by simultaneously fitting the spectra from multiple different antennas, which can be used in combination with the method of utilizing the time dependence of foregrounds while fitting multiple drift scan spectra. To demonstrate this idea, we consider two different foreground models (i) a simple foreground model, where we assume a constant spectral index over the sky, and (ii) a more realistic foreground model, with a spatial variation of the spectral index. For the simple foreground model, with just a single antenna design, we are able to extract the signal with good accuracy if we simultaneously fit the data from multiple time slices. The 21-cm signal extraction is further improved when we simultaneously fit the data from different antennas as well. This improvement becomes more pronounced while using the more realistic mock observations generated from the detailed foreground model. We find that even if we fit multiple time slices, the recovered signal is biased and inaccurate for a single antenna. However, simultaneously fitting the data from different antennas reduces the bias and the uncertainty by a factor of 2-3 on the extracted 21-cm signal., Comment: 12 pages, 13 figures. Accepted for publication in MNRAS. Accompanying code is available https://github.com/anchal-009/SAVED21cm

Measurement of the global 21-cm signal during Cosmic Dawn (CD) and the Epoch of Reionization (EoR) is made difficult by bright foreground emission which is 2-5 orders of magnitude larger than the expected signal. Fitting for a physics-motivated parametric forward model of the data within a Bayesian framework provides a robust means to separate the signal from the foregrounds, given sufficient information about the instrument and sky. It has previously been demonstrated that, within such a modelling framework, a foreground model of sufficient fidelity can be generated by dividing the sky into $N$ regions and scaling a base map assuming a distinct uniform spectral index in each region. Using the Radio Experiment for the Analysis of Cosmic Hydrogen (REACH) as our fiducial instrument, we show that, if unaccounted-for, amplitude errors in low-frequency radio maps used for our base map model will prevent recovery of the 21-cm signal within this framework, and that the level of bias in the recovered 21-cm signal is proportional to the amplitude and the correlation length of the base-map errors in the region. We introduce an updated foreground model that is capable of accounting for these measurement errors by fitting for a monopole offset and a set of spatially-dependent scale factors describing the ratio of the true and model sky temperatures, with the size of the set determined by Bayesian evidence-based model comparison. We show that our model is flexible enough to account for multiple foreground error scenarios allowing the 21-cm sky-averaged signal to be detected without bias from simulated observations with a smooth conical log spiral antenna., Comment: 18 pages, 13 figures

Detecting cosmological signals from the Epoch of Reionization (EoR) requires high-precision calibration to isolate the cosmological signals from foreground emission. In radio interferometery, perturbed primary beams of antenna elements can disrupt the precise calibration, which results in contaminating the foreground-free region, or the EoR window, in the cylindrically averaged power spectrum. For Hydrogen Epoch of Reionization Array (HERA), we simulate and characterize the perturbed primary beams induced by feed motions such as axial, lateral, and tilting motions, above the 14-meter dish. To understand the effect of the perturbed beams, visibility measurements are modeled with two different foreground components, point sources and diffuse sources, and we find different feed motions present a different reaction to each type of sky source. HERA's redundant-baseline calibration in the presence of non-redundant antenna beams due to feed motions introduces chromatic errors in gain solutions, which produces foreground power leakage into the EoR window. The observed leakage from vertical feed motions comes predominately from point sources around zenith. Furthermore, the observed leakage from horizontal and tilting feed motion comes predominately from the diffuse components near the horizon. Mitigation of chromatic gain errors will be necessary for robust detection of the EoR signals with minimal foreground bias, and this will be discussed in the subsequent paper., Comment: Accepted for publication in ApJ

Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data., Comment: 21 pages, 13 figures

Global 21cm cosmology aims to investigate the cosmic dawn and epoch of reionisation by measuring the sky averaged HI absorption signal, which requires, accurate modelling of, or correction for, the bright radio foregrounds and distortions arising from chromaticity of the antenna beam. We investigate the effect of improving foreground modelling by fitting data sets from many observation times simultaneously in a single Bayesian analysis, fitting for the same parameter set by performing these fits on simulated data. We find that for a hexagonal dipole antenna, this simultaneous fitting produces a significant improvement in the accuracy of the recovered 21cm signal, relative to fitting a time average of the data. Furthermore, the recovered models of the foreground are also seen to become more accurate by up to a factor of $\sim$2-3 relative to time averaged fitting. For a less chromatic log spiral antenna, no significant improvement in signal recovery was found by this process. However, the modelling of the foregrounds was still significantly improved. We also investigate extending this technique to fit multiple data sets from different antennae simultaneously for the same parameters. This is also found to improve both 21cm signal and foreground modelling, to a higher degree than fitting data set from multiple times from the same antenna., Comment: 19 pages, 19 figures

We report the most sensitive upper limits to date on the 21 cm epoch of reionization power spectrum using 94 nights of observing with Phase I of the Hydrogen Epoch of Reionization Array (HERA). Using similar analysis techniques as in previously reported limits (HERA Collaboration 2022a), we find at 95% confidence that $\Delta^2(k = 0.34$ $h$ Mpc$^{-1}$) $\leq 457$ mK$^2$ at $z = 7.9$ and that $\Delta^2 (k = 0.36$ $h$ Mpc$^{-1}) \leq 3,496$ mK$^2$ at $z = 10.4$, an improvement by a factor of 2.1 and 2.6 respectively. These limits are mostly consistent with thermal noise over a wide range of $k$ after our data quality cuts, despite performing a relatively conservative analysis designed to minimize signal loss. Our results are validated with both statistical tests on the data and end-to-end pipeline simulations. We also report updated constraints on the astrophysics of reionization and the cosmic dawn. Using multiple independent modeling and inference techniques previously employed by HERA Collaboration (2022b), we find that the intergalactic medium must have been heated above the adiabatic cooling limit at least as early as $z = 10.4$, ruling out a broad set of so-called "cold reionization" scenarios. If this heating is due to high-mass X-ray binaries during the cosmic dawn, as is generally believed, our result's 99% credible interval excludes the local relationship between soft X-ray luminosity and star formation and thus requires heating driven by evolved low-metallicity stars., Comment: 57 pages, 37 figures. Updated to match the accepted ApJ version. Corresponding author: Joshua S. Dillon

Combining the visibilities measured by an interferometer to form a cosmological power spectrum is a complicated process. In a delay-based analysis, the mapping between instrumental and cosmological space is not a one-to-one relation. Instead, neighbouring modes contribute to the power measured at one point, with their respective contributions encoded in the window functions. To better understand the power measured by an interferometer, we assess the impact of instrument characteristics and analysis choices on these window functions. Focusing on the Hydrogen Epoch of Reionization Array (HERA) as a case study, we find that long-baseline observations correspond to enhanced low-k tails of the window functions, which facilitate foreground leakage, whilst an informed choice of bandwidth and frequency taper can reduce said tails. With simple test cases and realistic simulations, we show that, apart from tracing mode mixing, the window functions help accurately reconstruct the power spectrum estimator of simulated visibilities. The window functions depend strongly on the beam chromaticity, and less on its spatial structure - a Gaussian approximation, ignoring side lobes, is sufficient. Finally, we investigate the potential of asymmetric window functions, down-weighting the contribution of low-k power to avoid foreground leakage. The window functions presented here correspond to the latest HERA upper limits for the full Phase I data. They allow an accurate reconstruction of the power spectrum measured by the instrument and will be used in future analyses to confront theoretical models and data directly in cylindrical space., Comment: 18 pages, 19 figures, accepted for publication in MNRAS

Cosmological experiments often employ Bayesian workflows to derive constraints on cosmological and astrophysical parameters from their data. It has been shown that these constraints can be combined across different probes such as Planck and the Dark Energy Survey and that this can be a valuable exercise to improve our understanding of the universe and quantify tension between multiple experiments. However, these experiments are typically plagued by differing systematics, instrumental effects and contaminating signals, which we collectively refer to as `nuisance' components, that have to be modelled alongside target signals of interest. This leads to high dimensional parameter spaces, especially when combining data sets, with > 20 dimensions of which only around 5 correspond to key physical quantities. We present a means by which to combine constraints from different data sets in a computationally efficient manner by generating rapid, reusable and reliable marginal probability density estimators, giving us access to nuisance-free likelihoods. This is possible through the unique combination of nested sampling, which gives us access to Bayesian evidences, and the marginal Bayesian statistics code MARGARINE. Our method is lossless in the signal parameters, resulting in the same posterior distributions as would be found from a full nested sampling run over all nuisance parameters, and typically quicker than evaluating full likelihoods. We demonstrate our approach by applying it to the combination of posteriors from the Dark Energy Survey and Planck., Comment: Published in Phys. Sci. Forum 2022, 5(1), 1; https://doi.org/10.3390/psf2022005001

Bayesian analysis has become an indispensable tool across many different cosmological fields including the study of gravitational waves, the Cosmic Microwave Background and the 21-cm signal from the Cosmic Dawn among other phenomena. The method provides a way to fit complex models to data describing key cosmological and astrophysical signals and a whole host of contaminating signals and instrumental effects modelled with `nuisance parameters'. In this paper, we summarise a method that uses Masked Autoregressive Flows and Kernel Density Estimators to learn marginal posterior densities corresponding to core science parameters. We find that the marginal or 'nuisance-free' posteriors and the associated likelihoods have an abundance of applications including; the calculation of previously intractable marginal Kullback-Leibler divergences and marginal Bayesian Model Dimensionalities, likelihood emulation and prior emulation. We demonstrate each application using toy examples, examples from the field of 21-cm cosmology and samples from the Dark Energy Survey. We discuss how marginal summary statistics like the Kullback-Leibler divergences and Bayesian Model Dimensionalities can be used to examine the constraining power of different experiments and how we can perform efficient joint analysis by taking advantage of marginal prior and likelihood emulators. We package our multipurpose code up in the pip-installable code margarine for use in the wider scientific community., Comment: Accepted for MNRAS

The ionosphere introduces chromatic distortions on low frequency radio waves, and thus poses a hurdle for 21-cm cosmology. In this paper we introduce time-varying chromatic ionospheric effects on simulated antenna temperature data of a global 21-cm data analysis pipeline, and try to detect the injected global signal. We demonstrate that given turbulent ionospheric conditions, more than 5\% error in our knowledge of the ionospheric parameters could lead to comparatively low evidence and high root-mean-square error (RMSE), suggesting a false or null detection. When using a constant antenna beam for cases that include data at different times, the significance of the detection lowers as the number of time samples increases. It is also shown that for observations that include data at different times, readjusting beam configurations according to the time-varying ionospheric conditions should greatly improve the significance of a detection, yielding higher evidences and lower RMSE, and that it is a necessary procedure for a successful detection when the ionospheric conditions are not ideal., Comment: 8 pages, 7 figures, 7 tables

Motivated by the desire for wide-field images with well-defined statistical properties for 21cm cosmology, we implement an optimal mapping pipeline that computes a maximum likelihood estimator for the sky using the interferometric measurement equation. We demonstrate this direct optimal mapping with data from the Hydrogen Epoch of Reionization (HERA) Phase I observations. After validating the pipeline with simulated data, we develop a maximum likelihood figure-of-merit for comparing four sky models at 166MHz with a bandwidth of 100kHz. The HERA data agree with the GLEAM catalogs to <10%. After subtracting the GLEAM point sources, the HERA data discriminate between the different continuum sky models, providing most support for the model of Byrne et al. 2021. We report the computation cost for mapping the HERA Phase I data and project the computation for the HERA 320-antenna data; both are feasible with a modern server. The algorithm is broadly applicable to other interferometers and is valid for wide-field and non-coplanar arrays., Comment: 16 pages, 10 figures, 2 tables, published on ApJ

We derive a general formalism for interferometric visibilities, which considers first-order antenna-antenna coupling and assumes steady-state, incident radiation. We simulate such coupling features for non-polarized skies on a compact, redundantly-spaced array and present a phenomenological analysis of the coupling features. Contrary to previous studies, we find mutual coupling features manifest themselves at nonzero fringe rates. We compare power spectrum results for both coupled and non-coupled (noiseless, simulated) data and find coupling effects to be highly dependent on LST, baseline length, and baseline orientation. For all LSTs, lengths, and orientations, coupling features appear at delays which are outside the foreground 'wedge', which has been studied extensively and contains non-coupled astrophysical foreground features. Further, we find that first-order coupling effects threaten our ability to average data from baselines with identical length and orientation. Two filtering strategies are proposed which may mitigate such coupling systematics. The semi-analytic coupling model herein presented may be used to study mutual coupling systematics as a function of LST, baseline length, and baseline orientation. Such a model is not only helpful to the field of 21cm cosmology, but any study involving interferometric measurements, where coupling effects at the level of at least 1 part in 10^4 could corrupt the scientific result. Our model may be used to mitigate coupling systematics in existing radio interferometers and to design future arrays where the configuration of array elements inherently mitigates coupling effects at desired LSTs and angular resolutions.

We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets., Comment: 31 pages, 17 figures

Recently, the Hydrogen Epoch of Reionization Array (HERA) collaboration has produced the experiment's first upper limits on the power spectrum of 21-cm fluctuations at z~8 and 10. Here, we use several independent theoretical models to infer constraints on the intergalactic medium (IGM) and galaxies during the epoch of reionization (EoR) from these limits. We find that the IGM must have been heated above the adiabatic cooling threshold by z~8, independent of uncertainties about the IGM ionization state and the nature of the radio background. Combining HERA limits with galaxy and EoR observations constrains the spin temperature of the z~8 neutral IGM to 27 K < T_S < 630 K (2.3 K < T_S < 640 K) at 68% (95%) confidence. They therefore also place a lower bound on X-ray heating, a previously unconstrained aspects of early galaxies. For example, if the CMB dominates the z~8 radio background, the new HERA limits imply that the first galaxies produced X-rays more efficiently than local ones (with soft band X-ray luminosities per star formation rate constrained to L_X/SFR = { 10^40.2, 10^41.9 } erg/s/(M_sun/yr) at 68% confidence), consistent with expectations of X-ray binaries in low-metallicity environments. The z~10 limits require even earlier heating if dark-matter interactions (e.g., through millicharges) cool down the hydrogen gas. Using a model in which an extra radio background is produced by galaxies, we rule out (at 95% confidence) the combination of high radio and low X-ray luminosities of L_{r,\nu}/SFR > 3.9 x 10^24 W/Hz/(M_sun/yr) and L_X/SFR<10^40 erg/s/(M_sun/yr). The new HERA upper limits neither support nor disfavor a cosmological interpretation of the recent EDGES detection. The analysis framework described here provides a foundation for the interpretation of future HERA results., Comment: 40 pages, 19 figures, accepted to ApJ

We report upper-limits on the Epoch of Reionization (EoR) 21 cm power spectrum at redshifts 7.9 and 10.4 with 18 nights of data ($\sim36$ hours of integration) from Phase I of the Hydrogen Epoch of Reionization Array (HERA). The Phase I data show evidence for systematics that can be largely suppressed with systematic models down to a dynamic range of $\sim10^9$ with respect to the peak foreground power. This yields a 95% confidence upper limit on the 21 cm power spectrum of $\Delta^2_{21} \le (30.76)^2\ {\rm mK}^2$ at $k=0.192\ h\ {\rm Mpc}^{-1}$ at $z=7.9$, and also $\Delta^2_{21} \le (95.74)^2\ {\rm mK}^2$ at $k=0.256\ h\ {\rm Mpc}^{-1}$ at $z=10.4$. At $z=7.9$, these limits are the most sensitive to-date by over an order of magnitude. While we find evidence for residual systematics at low line-of-sight Fourier $k_\parallel$ modes, at high $k_\parallel$ modes we find our data to be largely consistent with thermal noise, an indicator that the system could benefit from deeper integrations. The observed systematics could be due to radio frequency interference, cable sub-reflections, or residual instrumental cross-coupling, and warrant further study. This analysis emphasizes algorithms that have minimal inherent signal loss, although we do perform a careful accounting in a companion paper of the small forms of loss or bias associated with the pipeline. Overall, these results are a promising first step in the development of a tuned, instrument-specific analysis pipeline for HERA, particularly as Phase II construction is completed en route to reaching the full sensitivity of the experiment., Comment: Accepted to ApJ. https://reionization.org/science/public-data-release-1/

Global 21cm experiments aim to measure the sky averaged HI absorption signal from cosmic dawn and the epoch of reionisation. However, antenna chromaticity coupling to bright foregrounds can introduce distortions into the observational data of such experiments. We demonstrate a method for guiding the antenna design of a global experiment through data analysis simulations. This is done by performing simulated observations for a range of inserted 21cm signals, then attempting to identify the signals with a data analysis pipeline. We demonstrate this method on five antennae that were considered as potential designs for the Radio Experiment for the Analysis of Cosmic Hydrogen (REACH); a conical log spiral antenna, an inverted conical sinuous antenna and polygonal-, square- and elliptical-bladed dipoles. We find that the log spiral performs significantly better than the other antennae tested, able to correctly and confidently identify every inserted 21cm signal. In second place is the polygonal dipole antenna, which was only unable to detect signals with both very low amplitudes of 0.05K and low centre frequency of 80MHz. The conical sinuous antenna was found to perform least accurately, only able to detect the highest amplitude 21cm signals, and even then with biases. We also demonstrate that, due to the non-trivial nature of chromatic distortion and the processes of correcting for it, these are not the results that could have been expected superficially from the extent of chromatic variation in each antenna., Comment: 16 pages, 10 figures

Precision calibration poses challenges to experiments probing the redshifted 21-cm signal of neutral hydrogen from the Cosmic Dawn and Epoch of Reionization (z~30-6). In both interferometric and global signal experiments, systematic calibration is the leading source of error. Though many aspects of calibration have been studied, the overlap between the two types of instruments has received less attention. We investigate the sky based calibration of total power measurements with a HERA dish and an EDGES style antenna to understand the role of auto-correlations in the calibration of an interferometer and the role of sky in calibrating a total power instrument. Using simulations we study various scenarios such as time variable gain, incomplete sky calibration model, and primary beam model. We find that temporal gain drifts, sky model incompleteness, and beam inaccuracies cause biases in the receiver gain amplitude and the receiver temperature estimates. In some cases, these biases mix spectral structure between beam and sky resulting in spectrally variable gain errors. Applying the calibration method to the HERA and EDGES data, we find good agreement with calibration via the more standard methods. Although instrumental gains are consistent with beam and sky errors similar in scale to those simulated, the receiver temperatures show significant deviations from expected values. While we show that it is possible to partially mitigate biases due to model inaccuracies by incorporating a time-dependent gain model in calibration, the resulting errors on calibration products are larger and more correlated. Completely addressing these biases will require more accurate sky and primary beam models., Comment: 16 pages, 13 figures, 1 table; accepted for publication in MNRAS main journal

We describe the validation of the HERA Phase I software pipeline by a series of modular tests, building up to an end-to-end simulation. The philosophy of this approach is to validate the software and algorithms used in the Phase I upper limit analysis on wholly synthetic data satisfying the assumptions of that analysis, not addressing whether the actual data meet these assumptions. We discuss the organization of this validation approach, the specific modular tests performed, and the construction of the end-to-end simulations. We explicitly discuss the limitations in scope of the current simulation effort. With mock visibility data generated from a known analytic power spectrum and a wide range of realistic instrumental effects and foregrounds, we demonstrate that the current pipeline produces power spectrum estimates that are consistent with known analytic inputs to within thermal noise levels (at the 2 sigma level) for k > 0.2 h/Mpc for both bands and fields considered. Our input spectrum is intentionally amplified to enable a strong `detection' at k ~0.2 h/Mpc -- at the level of ~25 sigma -- with foregrounds dominating on larger scales, and thermal noise dominating at smaller scales. Our pipeline is able to detect this amplified input signal after suppressing foregrounds with a dynamic range (foreground to noise ratio) of > 10^7. Our validation test suite uncovered several sources of scale-independent signal loss throughout the pipeline, whose amplitude is well-characterized and accounted for in the final estimates. We conclude with a discussion of the steps required for the next round of data analysis., Comment: 32 pages, 20 figures. Submitted to the Astrophysical Journal

As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen Epoch of Reionization Array (HERA), a radio interferometer endeavoring to provide the first detection of the highly redshifted 21 cm signal from Cosmic Dawn and the Epoch of Reionization by an interferometer. The RTP system consists of analysis routines run on raw data shortly after they are acquired, such as calibration and detection of radio-frequency interference (RFI) events. RTP works closely with the Librarian, the HERA data storage and transfer manager which automatically ingests data and transfers copies to other clusters for post-processing analysis. Both the RTP system and the Librarian are public and open source software, which allows for them to be modified for use in other scientific collaborations. When fully constructed, HERA is projected to generate over 50 terabytes (TB) of data each night, and the RTP system enables the successful scientific analysis of these data., Comment: 15 pages, 3 figures, published in Astronomy and Computing

Precise measurements of the 21 cm power spectrum are crucial for understanding the physical processes of hydrogen reionization. Currently, this probe is being pursued by low-frequency radio interferometer arrays. As these experiments come closer to making a first detection of the signal, error estimation will play an increasingly important role in setting robust measurements. Using the delay power spectrum approach, we have produced a critical examination of different ways that one can estimate error bars on the power spectrum. We do this through a synthesis of analytic work, simulations of toy models, and tests on small amounts of real data. We find that, although computed independently, the different error bar methodologies are in good agreement with each other in the noise-dominated regime of the power spectrum. For our preferred methodology, the predicted probability distribution function is consistent with the empirical noise power distributions from both simulated and real data. This diagnosis is mainly in support of the forthcoming HERA upper limit, and also is expected to be more generally applicable., Comment: 35 Pages, 9 Figures, 4 Tables. Replaced with accepted ApJ version; some clarifying text added in response to referee comments with no changes to results

We modelled the two major layer of Earth's ionosphere, the F-layer and the D-layer, by a simplified spatial model with temporal variance to study the chromatic ionospheric effects on global 21-cm observations. From the analyses, we found that the magnitude of the ionospheric disruptions due to ionospheric refraction and absorption can be greater than the expected global 21-cm signal, and the variation of its magnitude can differ, depending on the ionospheric conditions. Within the parameter space adopted in the model, the shape of the global 21-cm signal is distorted after propagating through the ionosphere, while its amplitude is weakened. It is observed that the ionospheric effects do not cancel out over time, and thus should be accounted for in the foreground calibration at each timestep to account for the chromaticity introduced by the ionosphere., Comment: 11 pages, 13 figures, 4 tables

The HI 21cm absorption line is masked by bright foregrounds and systematic distortions that arise due to the chromaticity of the antenna used to make the observation coupling to the spectral inhomogeneity of these foregrounds. We demonstrate that these distortions are sufficient to conceal the 21cm signal when the antenna is not perfectly achromatic and that simple corrections assuming a constant spatial distribution of foreground power are insufficient to overcome them. We then propose a new physics-motivated method of modelling the foregrounds of 21cm experiments in order to fit the chromatic distortions as part of the foregrounds. This is done by generating a simulated sky model across the observing band by dividing the sky into $N$ regions and scaling a base map assuming a distinct uniform spectral index in each region. The resulting sky map can then be convolved with a model of the antenna beam to give a model of foregrounds and chromaticity parameterised by the spectral indices of the $N$ regions. We demonstrate that fitting this model for varying $N$ using a Bayesian nested sampling algorithm and comparing the results using the evidence allows the 21cm signal to be reliably detected in data of a relatively smooth conical log spiral antenna. We also test a much more chromatic conical sinuous antenna and find this model will not produce a reliable signal detection, but in a manner that is easily distinguishable from a true detection., Comment: 20 pages, 18 figures

This paper presents the design of a new dual-polarised Vivaldi feed for the Hydrogen Epoch of Reionization Array (HERA) radio-telescope. This wideband feed has been developed to replace the Phase I dipole feed, and is used to illuminate a 14-m diameter dish. It aims to improve the science capabilities of HERA, by allowing it to characterise the redshifted 21-cm hydrogen signal from the Cosmic Dawn as well as from the Epoch of Reionization. This is achieved by increasing the bandwidth from 100 -- 200 MHz to 50 -- 250 MHz, optimising the time response of the antenna - receiver system, and improving its sensitivity. This new Vivaldi feed is directly fed by a differential front-end module placed inside the circular cavity and connected to the back-end via cables which pass in the middle of the tapered slot. We show that this particular configuration has minimal effects on the radiation pattern and on the system response., Comment: 15 pages, 32 figures. This article has been accepted for publication in IEEE Transactions on Antennas and Propagation. This is the author's version which has not been fully edited and content may change prior to final publication. Citation information: DOI 10.1109/TAP.2021.3083788. Copyright 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission