Search

Measuring the environments of massive galaxies at high redshift is crucial to understanding galaxy evolution and the conditions that gave rise to the distribution of matter we see in the Universe today. While high-$z$ radio galaxies (H$z$RGs) and quasars tend to reside in protocluster-like systems, the environments of their radio-quiet counterparts are relatively unexplored, particularly in the submillimetre, which traces dust-obscured star formation. In this study we search for 850 $\mu$m-selected submillimetre galaxies in the environments of massive ($M_{\star} > 10^{11} M_{\odot}$), radio-quiet ($L_{500 {\rm MHz}} \lesssim 10^{25}$ W Hz$^{-1}$) galaxies at $z \sim 1\text{--}3$ using S2COSMOS data. By constructing number counts in circular regions of radius 1--6 arcmin and comparing with blank-field measurements, we find no significant overdensities of SMGs around massive radio-quiet galaxies at any of these scales, despite being sensitive down to overdensities of $\delta \sim 0.4$. To probe deeper than the catalogue we also examine the distribution of peaks in the SCUBA-2 SNR map, which reveals only tentative signs of any difference in the SMG densities of the radio-quiet galaxy environments compared to the blank field, and only on smaller scales (1$^{\prime}$ radii, corresponding to $\sim0.5$ Mpc) and higher SNR thresholds. We conclude that massive, radio-quiet galaxies at cosmic noon are typically in environments with $\delta\lesssim0.4$, which are either consistent with the blank field or contain only weak overdensities spanning sub-Mpc scales. The contrast between our results and studies of H$z$RGs with similar stellar masses and redshifts implies an intrinsic link between the wide-field environment and radio AGN luminosity at high redshift., Comment: 13 pages, 5 figures. Accepted for publication in MNRAS. Typos corrected, acknowledgements added

Spectral energy distribution (SED) fitting has been extensively used to determine the nature of the faint radio source population. Recent efforts have combined fits from multiple SED-fitting codes to account for the host galaxy and any active nucleus that may be present. We show that it is possible to produce similar-quality classifications using a single energy-balance SED fitting code, Prospector, to model up to 26 bands of UV$-$far-infrared aperture-matched photometry for $\sim$31,000 sources in the ELAIS-N1 field from the LOFAR Two-Metre Sky Survey (LoTSS) Deep fields first data release. One of a new generation of SED-fitting codes, Prospector accounts for potential contributions from radiative active galactic nuclei (AGN) when estimating galaxy properties, including star formation rates (SFRs) derived using non-parametric star formation histories. Combining this information with radio luminosities, we classify 92 per cent of the radio sources as a star-forming galaxy, high/low-excitation radio galaxy, or radio-quiet AGN and study the population demographics as a function of 150 MHz flux density, luminosity, SFR, stellar mass, redshift and apparent $r$-band magnitude. Finally, we use Prospector SED fits to investigate the SFR$-$150 MHz luminosity relation for a sample of $\sim$$133,000~3.6~\mu$m-selected $z<1$ sources, finding that the stellar mass dependence is significantly weaker than previously reported, and may disappear altogether at $\log_{10} (\mathrm{SFR}/M_\odot~\mathrm{yr}^{-1}) > 0.5$. This approach makes it significantly easier to classify radio sources from LoTSS and elsewhere, and may have important implications for future studies of star-forming galaxies at radio wavelengths., Comment: 20 pages, 13 figures, accepted for publication in MNRAS

The rapid proliferation of AI models has underscored the importance of thorough documentation, as it enables users to understand, trust, and effectively utilize these models in various applications. Although developers are encouraged to produce model cards, it's not clear how much information or what information these cards contain. In this study, we conduct a comprehensive analysis of 32,111 AI model documentations on Hugging Face, a leading platform for distributing and deploying AI models. Our investigation sheds light on the prevailing model card documentation practices. Most of the AI models with substantial downloads provide model cards, though the cards have uneven informativeness. We find that sections addressing environmental impact, limitations, and evaluation exhibit the lowest filled-out rates, while the training section is the most consistently filled-out. We analyze the content of each section to characterize practitioners' priorities. Interestingly, there are substantial discussions of data, sometimes with equal or even greater emphasis than the model itself. To evaluate the impact of model cards, we conducted an intervention study by adding detailed model cards to 42 popular models which had no or sparse model cards previously. We find that adding model cards is moderately correlated with an increase weekly download rates. Our study opens up a new perspective for analyzing community norms and practices for model documentation through large-scale data science and linguistics analysis.

Expert feedback lays the foundation of rigorous research. However, the rapid growth of scholarly production and intricate knowledge specialization challenge the conventional scientific feedback mechanisms. High-quality peer reviews are increasingly difficult to obtain. Researchers who are more junior or from under-resourced settings have especially hard times getting timely feedback. With the breakthrough of large language models (LLM) such as GPT-4, there is growing interest in using LLMs to generate scientific feedback on research manuscripts. However, the utility of LLM-generated feedback has not been systematically studied. To address this gap, we created an automated pipeline using GPT-4 to provide comments on the full PDFs of scientific papers. We evaluated the quality of GPT-4's feedback through two large-scale studies. We first quantitatively compared GPT-4's generated feedback with human peer reviewer feedback in 15 Nature family journals (3,096 papers in total) and the ICLR machine learning conference (1,709 papers). The overlap in the points raised by GPT-4 and by human reviewers (average overlap 30.85% for Nature journals, 39.23% for ICLR) is comparable to the overlap between two human reviewers (average overlap 28.58% for Nature journals, 35.25% for ICLR). The overlap between GPT-4 and human reviewers is larger for the weaker papers. We then conducted a prospective user study with 308 researchers from 110 US institutions in the field of AI and computational biology to understand how researchers perceive feedback generated by our GPT-4 system on their own papers. Overall, more than half (57.4%) of the users found GPT-4 generated feedback helpful/very helpful and 82.4% found it more beneficial than feedback from at least some human reviewers. While our findings show that LLM-generated feedback can help researchers, we also identify several limitations.

This paper presents a physics-informed neural network (PINN) approach for monitoring the health of diesel engines. The aim is to evaluate the engine dynamics, identify unknown parameters in a "mean value" model, and anticipate maintenance requirements. The PINN model is applied to diesel engines with a variable-geometry turbocharger and exhaust gas recirculation, using measurement data of selected state variables. The results demonstrate the ability of the PINN model to predict simultaneously both unknown parameters and dynamics accurately with both clean and noisy data, and the importance of the self-adaptive weight in the loss function for faster convergence. The input data for these simulations are derived from actual engine running conditions, while the outputs are simulated data, making this a practical case study of PINN's ability to predict real-world dynamical systems. The mean value model of the diesel engine incorporates empirical formulae to represent certain states, but these formulae may not be generalizable to other engines. To address this, the study considers the use of deep neural networks (DNNs) in addition to the PINN model. The DNNs are trained using laboratory test data and are used to model the engine-specific empirical formulae in the mean value model, allowing for a more flexible and adaptive representation of the engine's states. In other words, the mean value model uses both the PINN model and the DNNs to represent the engine's states, with the PINN providing a physics-based understanding of the engine's overall dynamics and the DNNs offering a more engine-specific and adaptive representation of the empirical formulae. By combining these two approaches, the study aims to offer a comprehensive and versatile approach to monitoring the health and performance of diesel engines.

We develop a data-driven deep neural operator framework to approximate multiple output states for a diesel engine and generate real-time predictions with reasonable accuracy. As emission norms become more stringent, the need for fast and accurate models that enable analysis of system behavior have become an essential requirement for system development. The fast transient processes involved in the operation of a combustion engine make it difficult to develop accurate physics-based models for such systems. As an alternative to physics based models, we develop an operator-based regression model (DeepONet) to learn the relevant output states for a mean-value gas flow engine model using the engine operating conditions as input variables. We have adopted a mean-value model as a benchmark for comparison, simulated using Simulink. The developed approach necessitates using the initial conditions of the output states to predict the accurate sequence over the temporal domain. To this end, a sequence-to-sequence approach is embedded into the proposed framework. The accuracy of the model is evaluated by comparing the prediction output to ground truth generated from Simulink model. The maximum $\mathcal L_2$ relative error observed was approximately $6.5\%$. The sensitivity of the DeepONet model is evaluated under simulated noise conditions and the model shows relatively low sensitivity to noise. The uncertainty in model prediction is further assessed by using a mean ensemble approach. The worst-case error at the $(\mu + 2\sigma)$ boundary was found to be $12\%$. The proposed framework provides the ability to predict output states in real-time and enables data-driven learning of complex input-output operator mapping. As a result, this model can be applied during initial development stages, where accurate models may not be available., Comment: Updated manuscript title to better reflect this work and field of study

High performance calorimetry conducted at future hadron colliders, such as the FCC-hh, poses a significant challenge for applying current detector technologies due to unprecedented beam luminosities and radiation fields. Solutions include developing scintillators that are capable of separating events at the sub-fifty picosecond level while also maintaining performance after extreme and constant neutron and ionizing radiation exposure. The RADiCAL is an approach that incorporates radiation tolerant materials in a sampling 'shashlik' style calorimeter configuration, using quartz capillaries filled with organic liquid or polymer-based wavelength shifters embedded in layers of tungsten plates and LYSO crystals. This novel design intends to address the Priority Research Directions (PRD) for calorimetry listed in the DOE Basic Research Needs (BRN) workshop for HEP Instrumentation. Here we report preliminary results from an experimental run at the Fermilab Test Beam Facility in June 2022. These tests demonstrate that the RADiCAL concept is capable of < 50 ps timing resolution., Comment: 5 pages, 10 figures, SCINT22 conference

The Survey for Distant Solar Twins (SDST) aims to find stars very similar to the Sun at distances 1-4 kpc, several times more distant than any currently known solar twins and analogues. The goal is to identify the best stars with which to test whether the fine-structure constant, alpha, varies with dark matter density in our Galaxy. Here we use EPIC, our line-by-line differential technique, to measure the stellar parameters - effective temperature Teff, surface gravity log g, metallicity [Fe/H] - from moderate resolution (R < 32,000) spectra of 877 solar twin and analogue candidates (547 at 1-4 kpc) observed with the HERMES spectrograph on the Anglo-Australian Telescope. These are consistent with expectations for Teff and log g from photometry, and for [Fe/H] from the Besancon stellar population model. EPIC provides small enough uncertainties (~90 K, 0.08 dex, 0.05 dex, respectively), even at the low signal-to-noise ratios available (S/N >~ 25 per pixel), to identify 299 new solar analogues (> 90% confidence), and 20 solar twins (>50% confidence), 206 and 12 of which are at 1-4 kpc. By extending EPIC to measure line broadening and lithium abundance from HERMES spectra, and with ages derived from isochrone fitting with our stellar parameters, we identify 174 solar analogues at 1-4 kpc which are relatively inactive, slowly rotating, and with no evidence of spectroscopic binarity. These are the preferred targets for follow-up spectroscopy to measure alpha., Comment: 12 pages, 12 figures. Accepted by MNRAS. The full table of stars used in this work can be found at https://doi.org/10.5281/zenodo.7332606

The increasingly wide usage of location aware sensors has made it possible to collect large volume of trajectory data in diverse application domains. Machine learning allows to study the activities or behaviours of moving objects (e.g., people, vehicles, robot) using such trajectory data with rich spatiotemporal information to facilitate informed strategic and operational decision making. In this study, we consider the task of classifying the activities of moving objects from their noisy indoor trajectory data in a collaborative manufacturing environment. Activity recognition can help manufacturing companies to develop appropriate management policies, and optimise safety, productivity, and efficiency. We present a semi-supervised machine learning approach that first applies an information theoretic criterion to partition a long trajectory into a set of segments such that the object exhibits homogeneous behaviour within each segment. The segments are then labelled automatically based on a constrained hierarchical clustering method. Finally, a deep learning classification model based on convolutional neural networks is trained on trajectory segments and the generated pseudo labels. The proposed approach has been evaluated on a dataset containing indoor trajectories of multiple workers collected from a tricycle assembly workshop. The proposed approach is shown to achieve high classification accuracy (F-score varies between 0.81 to 0.95 for different trajectories) using only a small proportion of labelled trajectory segments.

Studies of solar twins have key impacts on the astronomical community, but only $\sim$100--200 nearby solar twins ($<$ 1 kpc) have been reliably identified over the last few decades. The aim of our survey (SDST) is to identify $\sim$150--200 distant solar twins and analogues (up to $\lesssim$ 4 kpc) closer to the Galactic Centre. We took advantage of the precise Gaia and Skymapper surveys to select Sun-like candidates in a 2-degree field, which were observed with the HERMES spectrograph on the Anglo-Australian Telescope. We successfully built up the required signal-to-noise ratio (25-per-pixel in the HERMES red band) for most targets as faint as Gaia G of 17.4 mag. The stellar photometric/astrometric parameters (e.g., \teff, \logg, mass) of our candidates are derived in this paper, while the spectroscopic parameters will be presented in the third paper in this SDST series. The selection success rate - the fraction of targets which belong to solar twins or analogues - was estimated from simulated survey data and the Besan\c{c}on stellar population model, and compared with the actual success rate of the survey. We find that expected and actual success rates agree well, indicating that the numbers of solar twins and analogues we discover in SDST are consistent with expectations, affirming the survey approach. These distant solar analogues are prime targets for testing for any variation in the strength of electromagnetism in regions of higher dark matter density, and can make additional contributions to our understanding of, e.g., Galactic chemical evolution in the inner Milky Way., Comment: 15 pages, 13 figures. Accepted by MNRAS

Data-driven decision making is becoming an integral part of manufacturing companies. Data is collected and commonly used to improve efficiency and produce high quality items for the customers. IoT-based and other forms of object tracking are an emerging tool for collecting movement data of objects/entities (e.g. human workers, moving vehicles, trolleys etc.) over space and time. Movement data can provide valuable insights like process bottlenecks, resource utilization, effective working time etc. that can be used for decision making and improving efficiency. Turning movement data into valuable information for industrial management and decision making requires analysis methods. We refer to this process as movement analytics. The purpose of this document is to review the current state of work for movement analytics both in manufacturing and more broadly. We survey relevant work from both a theoretical perspective and an application perspective. From the theoretical perspective, we put an emphasis on useful methods from two research areas: machine learning, and logic-based knowledge representation. We also review their combinations in view of movement analytics, and we discuss promising areas for future development and application. Furthermore, we touch on constraint optimization. From an application perspective, we review applications of these methods to movement analytics in a general sense and across various industries. We also describe currently available commercial off-the-shelf products for tracking in manufacturing, and we overview main concepts of digital twins and their applications.

WEAVE is the new wide-field spectroscopic facility for the prime focus of the William Herschel Telescope in La Palma, Spain. Its fibre positioner is essential for the accurate placement of the spectrograph's ~960-fibre multiplex. To maximise the assignment of its optical fibres, WEAVE uses a simulated annealing algorithm called Configure, which allocates the fibres to targets in the field of view. We have conducted an analysis of the algorithm's behaviour using a subset of mid-tier WEAVE-LOFAR fields, and adjusted the priority assignment algorithm to optimise the total fibres assigned per field, and the assignment of fibres to the higher priority science targets. The output distributions have been examined, to investigate the implications for the WEAVE science teams., Comment: 19 pages, 17 figures

Self-Supervised Learning (SSL) is a new paradigm for learning discriminative representations without labelled data and has reached comparable or even state-of-the-art results in comparison to supervised counterparts. Contrastive Learning (CL) is one of the most well-known approaches in SSL that attempts to learn general, informative representations of data. CL methods have been mostly developed for applications in computer vision and natural language processing where only a single sensor modality is used. A majority of pervasive computing applications, however, exploit data from a range of different sensor modalities. While existing CL methods are limited to learning from one or two data sources, we propose COCOA (Cross mOdality COntrastive leArning), a self-supervised model that employs a novel objective function to learn quality representations from multisensor data by computing the cross-correlation between different data modalities and minimizing the similarity between irrelevant instances. We evaluate the effectiveness of COCOA against eight recently introduced state-of-the-art self-supervised models, and two supervised baselines across five public datasets. We show that COCOA achieves superior classification performance to all other approaches. Also, COCOA is far more label-efficient than the other baselines including the fully supervised model using only one-tenth of available labelled data., Comment: 27 pages, 10 figures, 6 tables, Accepted with minor revision at IMWUT Vol. 6 No. 3

New-generation radio telescopes like LOFAR are conducting extensive sky surveys, detecting millions of sources. To maximise the scientific value of these surveys, radio source components must be properly associated into physical sources before being cross-matched with their optical/infrared counterparts. In this paper, we use machine learning to identify those radio sources for which either source association is required or statistical cross-matching to optical/infrared catalogues is unreliable. We train a binary classifier using manual annotations from the LOFAR Two-metre Sky Survey (LoTSS). We find that, compared to a classification model based on just the radio source parameters, the addition of features of the nearest-neighbour radio sources, the potential optical host galaxy, and the radio source composition in terms of Gaussian components, all improve model performance. Our best model, a gradient boosting classifier, achieves an accuracy of 95 per cent on a balanced dataset and 96 per cent on the whole (unbalanced) sample after optimising the classification threshold. Unsurprisingly, the classifier performs best on small, unresolved radio sources, reaching almost 99 per cent accuracy for sources smaller than 15 arcsec, but still achieves 70 per cent accuracy on resolved sources. It flags 68 per cent more sources than required as needing visual inspection, but this is still fewer than the manually-developed decision tree used in LoTSS, while also having a lower rate of wrongly accepted sources for statistical analysis. The results have an immediate practical application for cross-matching the next LoTSS data releases and can be generalised to other radio surveys., Comment: Accepted for publication in MNRAS. 24 pages, 13 Figures. Submission includes a data table which is also available at https://drive.google.com/file/d/1mwKWJW6oCqh-joNR1uV3PPPYDdYz0n_J/view?usp=sharing

Recently, Self-Supervised Representation Learning (SSRL) has attracted much attention in the field of computer vision, speech, natural language processing (NLP), and recently, with other types of modalities, including time series from sensors. The popularity of self-supervised learning is driven by the fact that traditional models typically require a huge amount of well-annotated data for training. Acquiring annotated data can be a difficult and costly process. Self-supervised methods have been introduced to improve the efficiency of training data through discriminative pre-training of models using supervisory signals that have been freely obtained from the raw data. Unlike existing reviews of SSRL that have pre-dominately focused upon methods in the fields of CV or NLP for a single modality, we aim to provide the first comprehensive review of multimodal self-supervised learning methods for temporal data. To this end, we 1) provide a comprehensive categorization of existing SSRL methods, 2) introduce a generic pipeline by defining the key components of a SSRL framework, 3) compare existing models in terms of their objective function, network architecture and potential applications, and 4) review existing multimodal techniques in each category and various modalities. Finally, we present existing weaknesses and future opportunities. We believe our work develops a perspective on the requirements of SSRL in domains that utilise multimodal and/or temporal data, Comment: 36 pages, 5 figures, 9 tables, Survey paper