Search

This study explored the impact of the 95 Phonics Core Program® (95 PCP) on student literacy achievement across third graders who started the school year at different ability levels. The primary focus of this report was to investigate the relationship between changes in phonics scores with the beginning and end-of-year i-Ready® assessments and outcomes on State of Texas Assessments of Academic Readiness (STAAR®). To this end, i-Ready scores were collected from 4 elementary schools in the Southside Independent School District in San Antonio, Texas, during the 2022-2023 academic school year. Third graders from all schools were aggregated by beginning-of-year (BOY) placement level in terms of grade-level skills (kindergarten, first grade, second grade, third grade). Outcomes were expressed in terms of gains on scale scores and performance levels in STAAR. The analysis compared EOY performance levels for students who grew different amounts in their phonics skills during the school year. The analysis progressed through the following questions, each adding a piece to the overall picture.

Suspended membranes of monoatomic graphene exhibit great potential for applications in electronic and nanoelectromechanical devices. In this work, a "hot and dry" transfer process is demonstrated to address the fabrication and patterning challenges of large-area graphene membranes on top of closed, sealed cavities. Here, "hot" refers to the use of high temperature during transfer, promoting the adhesion. Additionally, "dry" refers to the absence of liquids when graphene and target substrate are brought into contact. The method leads to higher yields of intact suspended monolayer CVD graphene and artificially stacked double-layer CVD graphene membranes than previously reported. The yield evaluation is performed using neural-network-based object detection in SEM images, ascertaining high yields of intact membranes with large statistical accuracy. The suspended membranes are examined by Raman tomography and AFM. The method is verified by applying the suspended graphene devices as piezoresistive pressure sensors. Our technology advances the application of suspended graphene membranes and can be extended to other two-dimensional (2D) materials., Comment: 30 pages of manuscript plus 17 pages of Supporting Information

Astrophotonics represents a cutting-edge approach in observational astronomy. This paper explores the significant advancements and potential applications of astrophotonics, highlighting how photonic technologies stand to revolutionise astronomical instrumentation. Key areas of focus include photonic wavefront sensing and imaging, photonic interferometry and nulling, advanced chip fabrication methods, and the integration of spectroscopy and sensing onto photonic chips. The role of single-mode fibres in reducing modal noise, and the development of photonic integral field units (IFUs) and arrayed waveguide gratings (AWGs) for high-resolution, spatially resolved spectroscopy will be examined. As part of the Sydney regional-focus issue, this review aims to detail some of the current technological achievements in this field as well as to discuss the future trajectory of astrophotonics, underscoring its potential to unlock important new astronomical discoveries., Comment: Published version available at https://opg.optica.org/ao/fulltext.cfm?uri=ao-63-24-6393&id=554618

Quantum error correction provides a path to reach practical quantum computing by combining multiple physical qubits into a logical qubit, where the logical error rate is suppressed exponentially as more qubits are added. However, this exponential suppression only occurs if the physical error rate is below a critical threshold. In this work, we present two surface code memories operating below this threshold: a distance-7 code and a distance-5 code integrated with a real-time decoder. The logical error rate of our larger quantum memory is suppressed by a factor of $\Lambda$ = 2.14 $\pm$ 0.02 when increasing the code distance by two, culminating in a 101-qubit distance-7 code with 0.143% $\pm$ 0.003% error per cycle of error correction. This logical memory is also beyond break-even, exceeding its best physical qubit's lifetime by a factor of 2.4 $\pm$ 0.3. We maintain below-threshold performance when decoding in real time, achieving an average decoder latency of 63 $\mu$s at distance-5 up to a million cycles, with a cycle time of 1.1 $\mu$s. To probe the limits of our error-correction performance, we run repetition codes up to distance-29 and find that logical performance is limited by rare correlated error events occurring approximately once every hour, or 3 $\times$ 10$^9$ cycles. Our results present device performance that, if scaled, could realize the operational requirements of large scale fault-tolerant quantum algorithms., Comment: 10 pages, 4 figures, Supplementary Information

With the emergence of time-critical applications in modern communication networks, there is a growing demand for proactive network adaptation and quality of service (QoS) prediction. However, a fundamental question remains largely unexplored: how can we quantify and achieve more predictable communication systems in terms of performance? To address this gap, this paper introduces a theoretical framework for defining and analyzing predictability in communication systems, with a focus on the impact of observations for performance forecasting. We establish a mathematical definition of predictability based on the total variation distance between forecast and marginal performance distributions. A system is deemed unpredictable when the forecast distribution, providing the most comprehensive characterization of future states using all accessible information, is indistinguishable from the marginal distribution, which depicts the system's behavior without any observational input. This framework is applied to multi-hop systems under Markovian conditions, with a detailed analysis of Geo/Geo/1 queuing models in both single-hop and multi-hop scenarios. We derive exact and approximate expressions for predictability in these systems, as well as upper bounds based on spectral analysis of the underlying Markov chains. Our results have implications for the design of efficient monitoring and prediction mechanisms in future communication networks aiming to provide deterministic services.

Two-dimensional materials are extraordinarily sensitive to external stimuli, making them ideal for studying fundamental properties and for engineering devices with new functionalities. One such stimulus, strain, affects the magnetic properties of the layered magnetic semiconductor CrSBr to such a degree that it can induce a reversible antiferromagnetic-to-ferromagnetic phase transition. Given the pervasiveness of non-uniform strain in exfoliated two-dimensional magnets, it is crucial to understand its impact on their magnetic behavior. Using scanning SQUID-on-lever microscopy, we directly image the effects of spatially inhomogeneous strain on the magnetization of layered CrSBr as it is polarized by a field applied along its easy axis. The evolution of this magnetization and the formation of domains is reproduced by a micromagnetic model, which incorporates the spatially varying strain and the corresponding changes in the local interlayer exchange stiffness. The observed sensitivity to small strain gradients along with similar images of a nominally unstrained CrSBr sample suggest that unintentional strain inhomogeneity influences the magnetic behavior of exfoliated samples and must be considered in the design of future devices., Comment: 15 pages, 4 figures, 1 supplementary section

Recent research has seen notable progress in the development of linkage-based artificial hands. While previous designs have focused on adaptive grasping, dexterity and biomimetic artificial skin, only a few systems have proposed a lightweight, accessible solution integrating tactile sensing with a compliant linkage-based mechanism. This paper introduces OPENGRASP LITE, an open-source, highly integrated, tactile, and lightweight artificial hand. Leveraging compliant linkage systems and MEMS barometer-based tactile sensing, it offers versatile grasping capabilities with six degrees of actuation. By providing tactile sensors and enabling soft grasping, it serves as an accessible platform for further research in tactile artificial hands., Comment: Accepted at IEEE/RSJ International Conference on Intelligent Robots and Systems, 14-18 October 2024

Recent years have seen a tremendous improvement in the quality of video generation and editing approaches. While several techniques focus on editing appearance, few address motion. Current approaches using text, trajectories, or bounding boxes are limited to simple motions, so we specify motions with a single motion reference video instead. We further propose to use a pre-trained image-to-video model rather than a text-to-video model. This approach allows us to preserve the exact appearance and position of a target object or scene and helps disentangle appearance from motion. Our method, called motion-textual inversion, leverages our observation that image-to-video models extract appearance mainly from the (latent) image input, while the text/image embedding injected via cross-attention predominantly controls motion. We thus represent motion using text/image embedding tokens. By operating on an inflated motion-text embedding containing multiple text/image embedding tokens per frame, we achieve a high temporal motion granularity. Once optimized on the motion reference video, this embedding can be applied to various target images to generate videos with semantically similar motions. Our approach does not require spatial alignment between the motion reference video and target image, generalizes across various domains, and can be applied to various tasks such as full-body and face reenactment, as well as controlling the motion of inanimate objects and the camera. We empirically demonstrate the effectiveness of our method in the semantic video motion transfer task, significantly outperforming existing methods in this context., Comment: Preprint. All videos in this paper are best viewed as animations with Acrobat Reader by pressing the highlighted frame of each video

To address the rural broadband challenge and to leverage the unique opportunities that rural regions provide for piloting advanced wireless applications, we design and implement the ARA wireless living lab for research and innovation in rural wireless systems and their applications in precision agriculture, community services, and so on. ARA focuses on the unique community, application, and economic context of rural regions, and it features the first-of-its-kind, real-world deployment of long-distance, high-capacity wireless x-haul and access platforms across a rural area of diameter over 30 km. With both software-defined radios and programmable COTS systems and through effective orchestration of these wireless resources with fiber as well as compute resources embedded end-to-end across user equipment, base stations, edge, and cloud, ARA offers programmability, performance, robustness, and heterogeneity at the same time, thus enabling rural-focused co-evolution of wireless and applications while helping advance the frontiers of wireless systems in domains such as O-RAN, NextG, and agriculture applications. Here we present the design principles and implementation strategies of ARA, characterize its performance and heterogeneity, and highlight example wireless and application experiments uniquely enabled by ARA., Comment: 17 pages, 18 figures

Let $S$ be a compact hyperbolic surface of genus $g\geq 2$ and let $I(S) = \frac{1}{\mathrm{Vol}(S)}\int_{S} \frac{1}{\mathrm{Inj}(x)^2 \wedge 1} dx$, where $\mathrm{Inj}(x)$ is the injectivity radius at $x$. We prove that for any $k\in \{1,\ldots, 2g-3\}$, the $k$-th eigenvalue $\lambda_k$ of the Laplacian satisfies \begin{equation*} \lambda_k \geq \frac{c k^2}{I(S) g^2} \, , \end{equation*} where $c>0$ is some universal constant. We use this bound to prove the heat kernel estimate \begin{equation*} \frac{1}{\mathrm{Vol}(S)} \int_S \Big| p_t(x,x) -\frac{1}{\mathrm{Vol}(S)} \Big | ~dx \leq C \sqrt{ \frac{I(S)}{t}} \qquad \forall t \geq 1 \, , \end{equation*} where $C<\infty$ is some universal constant. These bounds are optimal in the sense that for every $g\geq 2$ there exists a compact hyperbolic surface of genus $g$ satisfying the reverse inequalities with different constants., Comment: 18 pages, 2 figures

By training over large-scale datasets, zero-shot monocular depth estimation (MDE) methods show robust performance in the wild but often suffer from insufficiently precise details. Although recent diffusion-based MDE approaches exhibit appealing detail extraction ability, they still struggle in geometrically challenging scenes due to the difficulty of gaining robust geometric priors from diverse datasets. To leverage the complementary merits of both worlds, we propose BetterDepth to efficiently achieve geometrically correct affine-invariant MDE performance while capturing fine-grained details. Specifically, BetterDepth is a conditional diffusion-based refiner that takes the prediction from pre-trained MDE models as depth conditioning, in which the global depth context is well-captured, and iteratively refines details based on the input image. For the training of such a refiner, we propose global pre-alignment and local patch masking methods to ensure the faithfulness of BetterDepth to depth conditioning while learning to capture fine-grained scene details. By efficient training on small-scale synthetic datasets, BetterDepth achieves state-of-the-art zero-shot MDE performance on diverse public datasets and in-the-wild scenes. Moreover, BetterDepth can improve the performance of other MDE models in a plug-and-play manner without additional re-training.

GLINT is a nulling interferometer downstream of the SCExAO extreme-adaptive-optics system at the Subaru Telescope (Hawaii, USA), and is a pathfinder instrument for high-contrast imaging of circumstellar environments with photonic technologies. GLINT is effectively a testbed for more stable, compact, and modular instruments for the era of 30m-class telescopes. GLINT is now undergoing an upgrade with a new photonic chip for more achromatic nulls, and for phase information to enable fringe tracking. Here we provide an overview of the motivations for the GLINT project and report on the design of the new chip, the on-site installation, and current status., Comment: Proc. SPIE Astronomical Telescopes + Instrumentation 2024 (Yokohama, Japan), Optical and Infrared Interferometry and Imaging IX

Large language model (LLM) chatbots are susceptible to biases and hallucinations, but current evaluations of mental wellness technologies lack comprehensive case studies to evaluate their practical applications. Here, we address this gap by introducing the MHealth-EVAL framework, a new role-play based interactive evaluation method designed specifically for evaluating the appropriateness, trustworthiness, and safety of mental wellness chatbots. We also introduce Psyfy, a new chatbot leveraging LLMs to facilitate transdiagnostic Cognitive Behavioral Therapy (CBT). We demonstrate the MHealth-EVAL framework's utility through a comparative study of two versions of Psyfy against standard baseline chatbots. Our results showed that Psyfy chatbots outperformed the baseline chatbots in delivering appropriate responses, engaging users, and avoiding untrustworthy responses. However, both Psyfy and the baseline chatbots exhibited some limitations, such as providing predominantly US-centric resources. While Psyfy chatbots were able to identify most unsafe situations and avoid giving unsafe responses, they sometimes struggled to recognize subtle harmful intentions when prompted in role play scenarios. Our study demonstrates a practical application of the MHealth-EVAL framework and showcases Psyfy's utility in harnessing LLMs to enhance user engagement and provide flexible and appropriate responses aligned with an evidence-based CBT approach.

Purpose: Federated training is often hindered by heterogeneous datasets due to divergent data storage options, inconsistent naming schemes, varied annotation procedures, and disparities in label quality. This is particularly evident in the emerging multi-modal learning paradigms, where dataset harmonization including a uniform data representation and filtering options are of paramount importance. Methods: DICOM structured reports enable the standardized linkage of arbitrary information beyond the imaging domain and can be used within Python deep learning pipelines with highdicom. Building on this, we developed an open platform for data integration and interactive filtering capabilities that simplifies the process of assembling multi-modal datasets. Results: In this study, we extend our prior work by showing its applicability to more and divergent data types, as well as streamlining datasets for federated training within an established consortium of eight university hospitals in Germany. We prove its concurrent filtering ability by creating harmonized multi-modal datasets across all locations for predicting the outcome after minimally invasive heart valve replacement. The data includes DICOM data (i.e. computed tomography images, electrocardiography scans) as well as annotations (i.e. calcification segmentations, pointsets and pacemaker dependency), and metadata (i.e. prosthesis and diagnoses). Conclusion: Structured reports bridge the traditional gap between imaging systems and information systems. Utilizing the inherent DICOM reference system arbitrary data types can be queried concurrently to create meaningful cohorts for clinical studies. The graphical interface as well as example structured report templates will be made publicly available.

Transformer-based language models have shown state-of-the-art performance on a variety of natural language understanding tasks. To achieve this performance, these models are first pre-trained on general corpus and then fine-tuned on downstream tasks. Previous work studied the effect of pruning the training set of the downstream tasks on the performance of the model on its evaluation set. In this work, we propose an automatic dataset pruning method for the training set of fine-tuning tasks. Our method is based on the model's success rate in correctly classifying each training data point. Unlike previous work which relies on user feedback to determine subset size, our method automatically extracts training subsets that are adapted for each pair of model and fine-tuning task. Our method provides multiple subsets for use in dataset pruning that navigate the trade-off between subset size and evaluation accuracy. Our largest subset, which we also refer to as the winning ticket subset, is on average $3 \times$ smaller than the original training set of the fine-tuning task. Our experiments on 5 downstream tasks and 2 language models show that, on average, fine-tuning on the winning ticket subsets results in a $0.1 \%$ increase in the evaluation performance of the model., Comment: 28 pages, 17 figures. Accepted at the Third Conference on Lifelong Learning Agents (CoLLAs 2024)

Asgard/NOTT is an ERC-funded project hosted at KU Leuven and is part of a new visitor instrumental suite, called Asgard, under preparation for the Very Large Telescope Interferometer (VLTI). Leveraging nulling capabilities and the long VLTI baselines, it is optimized for high-contrast imaging of the snow line region around young nearby main-sequence stars. This will enable the characterization of the atmosphere of young giant exoplanets and warm/hot exozodiacal dust with spectroscopy in the L'-band (3.5-4.0$\mu$m). In this work, we present the first lab assembly of the instrument done at KU Leuven and the technical solutions to tackle the challenge of performing nulling in the mid-infrared despite the thermal background. The opto-mechanical design of the warm optics and the injection system for the photonic chip are described. The alignment procedure used to assemble the system is also presented. Finally, the first experimental results, including fringes and null measurements, are given and confirm the adequacy of the bench to test and optimize the Asgard/NOTT instrument., Comment: 13 pages (incl. 14 figures); Proc. SPIE Astronomical Telescopes + Instrumentation 2024 (Yokohama; Japan), Optical and Infrared Interferometry and Imaging IX

NOTT (formerly Hi-5) is the L'-band (3.5-4.0~microns) nulling interferometer of Asgard, an instrument suite in preparation for the VLTI visitor focus. The primary scientific objectives of NOTT include characterizing (i) young planetary systems near the snow line, a critical region for giant planet formation, and (ii) nearby main-sequence stars close to the habitable zone, with a focus on detecting exozodiacal dust that could obscure Earth-like planets. In 2023-2024, the final warm optics have been procured and assembled in a new laboratory at KU Leuven. First fringes and null measurements were obtained using a Gallium Lanthanum Sulfide (GLS) photonic chip that was also tested at cryogenic temperatures. In this paper, we present an overall update of the NOTT project with a particular focus on the cold mechanical design, the first results in the laboratory with the final NOTT warm optics, and the ongoing Asgard integration activities. We also report on other ongoing activities such as the characterization of the photonic chip (GLS, LiNbO3, SiO), the development of the exoplanet science case, the design of the dispersion control module, and the progress with the self-calibration data reduction software., Comment: 11 pages (incl. 5 figures); Proc. SPIE Astronomical Telescopes + Instrumentation 2024 (Yokohama; Japan), Optical and Infrared Interferometry and Imaging VI

Federated learning (FL) is a renowned technique for utilizing decentralized data while preserving privacy. However, real-world applications often involve inherent challenges such as partially labeled datasets, where not all clients possess expert annotations of all labels of interest, leaving large portions of unlabeled data unused. In this study, we conduct the largest federated cardiac CT imaging analysis to date, focusing on partially labeled datasets ($n=8,124$) of Transcatheter Aortic Valve Implantation (TAVI) patients over eight hospital clients. Transformer architectures, which are the major building blocks of current foundation models, have shown superior performance when trained on larger cohorts than traditional CNNs. However, when trained on small task-specific labeled sample sizes, it is currently not feasible to exploit their underlying attention mechanism for improved performance. Therefore, we developed a two-stage semi-supervised learning strategy that distills knowledge from several task-specific CNNs (landmark detection and segmentation of calcification) into a single transformer model by utilizing large amounts of unlabeled data typically residing unused in hospitals to mitigate these issues. This method not only improves the predictive accuracy and generalizability of transformer-based architectures but also facilitates the simultaneous learning of all partial labels within a single transformer model across the federation. Additionally, we show that our transformer-based model extracts more meaningful features for further downstream tasks than the UNet-based one by only training the last layer to also solve segmentation of coronary arteries. We make the code and weights of the final model openly available, which can serve as a foundation model for further research in cardiac CT imaging.

In models featuring extra spatial dimensions, particle collisions in the early universe can produce Kaluza-Klein gravitons. Such particles will later decay, potentially impacting the process of Big Bang nucleosynthesis. In this paper, we consider scenarios in which gravity is free to propagate throughout $n$ flat, compactified extra dimensions, while the fields of the Standard Model are confined to a 3+1 dimensional brane. We calculate the production and decay rates of the states that make up the Kaluza-Klein graviton tower and determine the evolution of their abundances in the early universe. We then go on to evaluate the impact of these decays on the resulting light element abundances. We identify significant regions of previously unexplored parameter space that are inconsistent with measurements of the primordial helium and deuterium abundances. In particular, we find that for the case of one extra dimension (two extra dimensions), the fundamental scale of gravity must be $M_{\star} > 2 \times 10^{13} \, {\rm GeV}$ ($M_{\star} > 10^{10} \, {\rm GeV}$) unless the temperature of the early universe was never greater than $T \sim 2 \, {\rm TeV}$ ($T \sim 1 \, {\rm GeV}$). For larger values of $n$, these constraints are less stringent. For the case of $n=6$, for example, our analysis excludes all values of $M_{\star}$ less than $\sim 10^{6} \, {\rm GeV}$, unless the temperature of the universe was never greater than $T \sim 3 \, {\rm TeV}$. The results presented here severely limit the possibility that black holes were efficiently produced through particle collisions in the early universe's thermal bath., Comment: 12 pages, 6 figures

Surfaces -- by breaking bulk symmetries, introducing roughness, or hosting defects -- can significantly influence magnetic order in magnetic materials. Determining their effect on the complex nanometer-scale phases present in certain non-centrosymmetric magnets is an outstanding problem requiring high-resolution magnetic microscopy. Here, we use scanning SQUID-on-tip microscopy to image the surface of bulk Cu$_2$OSeO$_3$ at low temperature and in a magnetic field applied along $\left\langle100\right\rangle$. Real-space maps measured as a function of applied field reveal the microscopic structure of the magnetic phases and their transitions. In low applied field, we observe a magnetic texture consistent with an in-plane stripe phase, pointing to the existence of a distinct surface state. In the low-temperature skyrmion phase, the surface is populated by clusters of disordered skyrmions, which emerge from rupturing domains of the tilted spiral phase. Furthermore, we displace individual skyrmions from their pinning sites by applying an electric potential to the scanning probe, thereby demonstrating local skyrmion control at the surface of a magnetoelectric insulator., Comment: 25 pages, 13 figures, including 1 appendix and references

We present a new method for multimodal conditional 3D face geometry generation that allows user-friendly control over the output identity and expression via a number of different conditioning signals. Within a single model, we demonstrate 3D faces generated from artistic sketches, 2D face landmarks, Canny edges, FLAME face model parameters, portrait photos, or text prompts. Our approach is based on a diffusion process that generates 3D geometry in a 2D parameterized UV domain. Geometry generation passes each conditioning signal through a set of cross-attention layers (IP-Adapter), one set for each user-defined conditioning signal. The result is an easy-to-use 3D face generation tool that produces high resolution geometry with fine-grain user control.

The reconstruction of particle tracks from hits in tracking detectors is a computationally intensive task due to the large combinatorics of detector signals. Recent efforts have proven that ML techniques can be successfully applied to the tracking problem, extending and improving the conventional methods based on feature engineering. However, complex models can be difficult to implement on heterogeneous trigger systems, integrating architectures such as FPGAs. Deploying the network on an FPGA is feasible but challenging and limited by its resources. An efficient alternative can employ symbolic regression (SR). We propose a novel approach that uses SR to replace a graph-based neural network. Substituting each network block with a symbolic function preserves the graph structure of the data and enables message passing. The technique is perfectly suitable for heterogeneous hardware, as it can be implemented more easily on FPGAs and grants faster execution times on CPU with respect to conventional methods. We note that while the tracking problem is the target for this work, it also provides a proof-of-principle for the method that can be applied to many use cases., Comment: 15 pages, 5 figures, 1 table

Vine copulas are flexible dependence models using bivariate copulas as building blocks. If the parameters of the bivariate copulas in the vine copula depend on covariates, one obtains a conditional vine copula. We propose an extension for the estimation of continuous conditional vine copulas, where the parameters of continuous conditional bivariate copulas are estimated sequentially and separately via gradient-boosting. For this purpose, we link covariates via generalized linear models (GLMs) to Kendall's $\tau$ correlation coefficient from which the corresponding copula parameter can be obtained. Consequently, the gradient-boosting algorithm estimates the copula parameters providing a natural covariate selection. In a second step, an additional covariate deselection procedure is applied. The performance of the gradient-boosted conditional vine copulas is illustrated in a simulation study. Linear covariate effects in low- and high-dimensional settings are investigated for the conditional bivariate copulas separately and for conditional vine copulas. Moreover, the gradient-boosted conditional vine copulas are applied to the temporal postprocessing of ensemble weather forecasts in a low-dimensional setting. The results show, that our suggested method is able to outperform the benchmark methods and identifies temporal correlations better. Eventually, we provide an R-package called boostCopula for this method.

Quantum effects like entanglement and coherent amplification can be used to drastically enhance the accuracy of quantum parameter estimation beyond classical limits. However, challenges such as decoherence and time-dependent errors hinder Heisenberg-limited amplification. We introduce Quantum Signal-Processing Phase Estimation algorithms that are robust against these challenges and achieve optimal performance as dictated by the Cram\'{e}r-Rao bound. These algorithms use quantum signal transformation to decouple interdependent phase parameters into largely orthogonal ones, ensuring that time-dependent errors in one do not compromise the accuracy of learning the other. Combining provably optimal classical estimation with near-optimal quantum circuit design, our approach achieves an unprecedented standard deviation accuracy of $10^{-4}$ radians for estimating unwanted swap angles in superconducting two-qubit experiments, using low-depth ($<10$) circuits. This represents up to two orders of magnitude improvement over existing methods. Theoretically and numerically, we demonstrate the optimality of our algorithm against time-dependent phase errors, observing that the variance of the time-sensitive parameter $\varphi$ scales faster than the asymptotic Heisenberg scaling in the small-depth regime. Our results are rigorously validated against the quantum Fisher information, confirming our protocol's ability to achieve unmatched precision for two-qubit gate learning., Comment: 53 pages, 21 figures. arXiv admin note: substantial text overlap with arXiv:2209.11207

We propose using mechanistic interpretability -- techniques for reverse engineering model weights into human-interpretable algorithms -- to derive and compactly prove formal guarantees on model performance. We prototype this approach by formally proving lower bounds on the accuracy of 151 small transformers trained on a Max-of-$K$ task. We create 102 different computer-assisted proof strategies and assess their length and tightness of bound on each of our models. Using quantitative metrics, we find that shorter proofs seem to require and provide more mechanistic understanding. Moreover, we find that more faithful mechanistic understanding leads to tighter performance bounds. We confirm these connections by qualitatively examining a subset of our proofs. Finally, we identify compounding structureless noise as a key challenge for using mechanistic interpretability to generate compact proofs on model performance., Comment: accepted to ICML 2024 Workshop on Mechanistic Interpretability (Spotlight)

We construct a convergent family of outer approximations for the problem of optimizing polynomial functions over convex bodies subject to polynomial constraints. This is achieved by generalizing the polarization hierarchy, which has previously been introduced for the study of polynomial optimization problems over state spaces of $C^*$-algebras, to convex cones in finite dimensions. If the convex bodies can be characterized by linear or semidefinite programs, then the same is true for our hierarchy. Convergence is proven by relating the problem to a certain de Finetti theorem for general probabilistic theories, which are studied as possible generalizations of quantum mechanics. We apply the method to the problem of nonnegative matrix factorization, and in particular to the nested rectangles problem. A numerical implementation of the third level of the hierarchy is shown to give rise to a very tight approximation for this problem., Comment: 11 pages, 1 figure

While digital libraries offer essential benefits for the digital age such as constant availability and accessibility, they often fail in providing a similarly enjoyable browsing experience that benefits engagement and serendipitous exploration inherent to traditional library experiences. In this paper, we propose a virtual reality (VR) library environment that emulates a traditional library promoting an engaging browsing experience that benefits browsing enjoyment and serendipity. The implemented system uses procedural content generation to dynamically generate a library-like environment, wherein each room corresponds to a specific category of the digital library. To assess the usability of the implemented system, we conducted an A-B study comparing the VR environment with the web interface of Project Gutenberg. The results of the study suggest that while the physical demand for using the VR environment is higher, the system can significantly benefit the browsing experience and entice users curiosity. Furthermore, the study suggests that the system can increase user engagement and users generally felt that using the system was rewarding., Comment: 15 pages, 3 figures

The differential cross section for $\gamma p\rightarrow K^+\Lambda(1520)$ was measured from threshold to a centre-of-mass energy of 2090\,MeV at forward angles at the BGOOD experiment. The high statistical precision and resolution in centre-of-mass energy and angle allows a detailed characterisation of this low-momentum transfer kinematic region. The data agree with a previous LEPS measurement and support effective Lagrangian models that indicate that the contact term dominates the cross section near threshold., Comment: 6 pages, 7 figures

Detector simulation and reconstruction are a significant computational bottleneck in particle physics. We develop Particle-flow Neural Assisted Simulations (Parnassus) to address this challenge. Our deep learning model takes as input a point cloud (particles impinging on a detector) and produces a point cloud (reconstructed particles). By combining detector simulations and reconstruction into one step, we aim to minimize resource utilization and enable fast surrogate models suitable for application both inside and outside large collaborations. We demonstrate this approach using a publicly available dataset of jets passed through the full simulation and reconstruction pipeline of the CMS experiment. We show that Parnassus accurately mimics the CMS particle flow algorithm on the (statistically) same events it was trained on and can generalize to jet momentum and type outside of the training distribution., Comment: 9 pages, 3 figures, 2 tables

Advanced experiments using THz pump and X-ray probe pulses at modern free-electron lasers (FELs) like the European X-ray FEL require a frequency-tunable, high-power, narrow-band THz source maintaining the repetition rate and pulse structure of the X-ray pulses. This paper reports the first results from a THz source, that is based on a single-pass high-gain THz FEL operating with a central wavelength of 100 micrometers. The THz FEL prototype is currently in operation at the Photo Injector Test facility at DESY in Zeuthen (PITZ) and uses the same type of electron source as the European XFEL photo injector. A self-amplified spontaneous emission (SASE) FEL was envisioned as the main mechanism for generating the THz pulses. Although the THz FEL at PITZ is supposed to use the same mechanism as at X-ray facilities, it cannot be considered as a simple scaling of the radiation wavelength because there is a large difference in the number of electrons per radiation wavelength, which is five orders of magnitude higher for the THz case. The bunching factor arising from the electron beam current profile contributes strongly to the initial spontaneous emission starting the FEL process. Proof-of-principle experiments were done at PITZ using an LCLS-I undulator to generate the first high-power, high-repetition-rate single-pass THz FEL radiation. Electron bunches with a beam energy of ~17 MeV and a bunch charge of up to several nC are used to generate THz pulses with a pulse energy of several tens of microjoules. For example, for an electron beam with a charge of ~2.4 nC, more than 100 microjoules were generated at a central wavelength of 100 micrometers. The narrowband spectrum was also demonstrated by spectral measurements. These proof-of-principle experiments pave the way for a tunable, high-repetition-rate THz source providing pulses with energies in the millijoule range., Comment: (unpublished) for submission to PRAB

Understanding how interacting particles approach thermal equilibrium is a major challenge of quantum simulators. Unlocking the full potential of such systems toward this goal requires flexible initial state preparation, precise time evolution, and extensive probes for final state characterization. We present a quantum simulator comprising 69 superconducting qubits which supports both universal quantum gates and high-fidelity analog evolution, with performance beyond the reach of classical simulation in cross-entropy benchmarking experiments. Emulating a two-dimensional (2D) XY quantum magnet, we leverage a wide range of measurement techniques to study quantum states after ramps from an antiferromagnetic initial state. We observe signatures of the classical Kosterlitz-Thouless phase transition, as well as strong deviations from Kibble-Zurek scaling predictions attributed to the interplay between quantum and classical coarsening of the correlated domains. This interpretation is corroborated by injecting variable energy density into the initial state, which enables studying the effects of the eigenstate thermalization hypothesis (ETH) in targeted parts of the eigenspectrum. Finally, we digitally prepare the system in pairwise-entangled dimer states and image the transport of energy and vorticity during thermalization. These results establish the efficacy of superconducting analog-digital quantum processors for preparing states across many-body spectra and unveiling their thermalization dynamics.

We describe the symmetry group of the stabilizer polytope for any number $n$ of systems and any prime local dimension $d$. In the qubit case, the symmetry group coincides with the linear and anti-linear Clifford operations. In the case of qudits, the structure is somewhat richer: for $n=1$, it is a wreath product of permutations of bases and permutations of the elements within each basis. For $n>1$, the symmetries are given by affine symplectic similitudes. These are the affine maps that preserve the symplectic form of the underlying discrete phase space up to a non-zero multiplier. We phrase these results with respect to a number of a priori different notions of "symmetry'', including Kadison symmetries (bijections that are compatible with convex combinations), Wigner symmetries (bijections that preserve inner products), and symmetries realized by an action on Hilbert space. Going beyond stabilizer states, we extend an observation of Heinrich and Gross (Ref. [25]) and show that the symmetries of fairly general sets of Hermitian operators are constrained by certain moments. In particular: the symmetries of a set that behaves like a 3-design preserve Jordan products and are therefore realized by conjugation with unitaries or anti-unitaries. (The structure constants of the Jordan algebra are encoded in an order-three tensor, which we connect to the third moments of a design). This generalizes Kadison's formulation of the classic Wigner Theorem on quantum mechanical symmetries., Comment: 21 pages, v2: minor notation changes and references added

The advancement of software sustainability encounters notable challenges, underscoring the necessity for understanding these challenges to facilitate significant progress and pave the way for effective solutions to advance software sustainability. This paper outlines key challenges identified in literature based on findings from a tertiary study. Challenges identified include: confusion regarding the definition of software sustainability, uncertainty about when to consider sustainability in software development, lack of assessment metrics and tools, narrow perspectives on sustainability in software systems, insufficient awareness and education, and a lack of serious considerations in practice. The paper aims at clarifying the confusion surrounding software sustainability to motivate effective solutions. The provided recommendations aim to give a more organized approach towards advancing sustainable software development, emphasizing comprehensive strategies, the integration of sustainability as a fundamental aspect of software development, actionable research directions, and the cultivation of a common understanding of sustainable software.

This paper focuses on the challenging task of bottom-up restoration in a complete blackout system using Grid-forming (GFM) converters. Challenges arise due to the limited current capability of power converters, resulting in distinct dynamic responses and fault current characteristics compared to synchronous generators. Additionally, GFM control needs to address the presence of unbalanced conditions commonly found in distribution systems. To address these challenges, this paper explores the black start capability of GFM converters with a generalized three-phase GFM droop control. This approach integrates GFM controls individually for each phase, incorporating phase-balancing feedback and enabling current limiting for each phase during unbalanced faults or overloading. The introduction of a phase-balancing gain provides flexibility to trade-off between voltage and power imbalances. The study further investigates bottom-up black start operations using GFM converters, incorporating advanced load relays into breakers for gradual load energization without central coordination. The effectiveness of bottom-up black start operations with GFM converters, utilizing the generalized three-phase GFM droop, is evaluated through electromagnetic transient (EMT) simulations in MATLAB/Simulink. The results confirm the performance and effectiveness of this approach in achieving successful black start operations under unbalanced conditions.

While there exist theories that have states "more strongly entangled" than quantum theory, in the sense that they show CHSH values above Tsirelson's bound, all known examples of such theories have a strictly smaller set of measurements. Therefore, in tasks which require both bipartite states and measurements, they do not perform better than QM. One of the simplest information processing tasks involving both bipartite states and measurements is that of entanglement swapping. In this paper, we study entanglement swapping in generalised probabilistic theories (GPTs). In particular, we introduce the iterated CHSH game, which measures the power of a GPT to preserve non-classical correlations, in terms of the largest CHSH value obtainable after $n$ rounds of entanglement swapping. Our main result is the construction of a GPT that achieves a CHSH value of $4$ after an arbitrary number of rounds. This addresses a question about the optimality of quantum theory for such games recently raised in the literature. One challenge faced when treating this problem is that there seems to be no general framework for constructing GPTs in which entanglement swapping is a well-defined operation. Therefore, we introduce an algorithmic construction that turns a bipartite GPT into a multipartite GPT that supports entanglement swapping, if consistently possible., Comment: 11 pages, 12 figures, v2: added references and contact information, v3: spurious 'test' removed from title (oof)

The computational intensity of detector simulation and event reconstruction poses a significant difficulty for data analysis in collider experiments. This challenge inspires the continued development of machine learning techniques to serve as efficient surrogate models. We propose a fast emulation approach that combines simulation and reconstruction. In other words, a neural network generates a set of reconstructed objects conditioned on input particle sets. To make this possible, we advance set-conditional set generation with diffusion models. Using a realistic, generic, and public detector simulation and reconstruction package (COCOA), we show how diffusion models can accurately model the complex spectrum of reconstructed particles inside jets., Comment: 15 pages, 10 figures, 2 tables

The coherent reaction, $\gamma d \rightarrow \pi^0\eta d$ was studied with the BGOOD experiment at ELSA from threshold to a centre-of-mass energy of 3200\,MeV. A full kinematic reconstruction was made, with final state deuterons identified in the forward spectrometer and $\pi^0$ and $\eta$ decays in the central BGO Rugby Ball. The strength of the differential cross section exceeds what can be described by models of coherent photoproduction at forward angles by orders of magnitude. The distribution of the differential cross section has an excellent agreement with a model including quasi-free $\Delta \pi$ photoproduction, pion re-scattering and $N(1535)$ formation and subsequent nucleon coalescence to the deuteron. This also gives a reasonable description of the two-body invariant mass distributions and naturally explains the similar magnitudes of this channel and $\pi^0\pi^0 d$ coherent photoproduction., Comment: 7 pages, 5 figures

We apply deep learning techniques to the late-time turbulent regime in a post-inflationary model where a real scalar inflaton field and the standard model Higgs doublet interact with renormalizable couplings between them. After inflation, the inflaton decays into the Higgs through a trilinear coupling and the Higgs field subsequently thermalizes with gauge bosons via its $SU(2)\times U(1)$ gauge interaction. Depending on the strength of the trilinear interaction and the Higgs self-coupling, the effective mass squared of Higgs can become negative, leading to the tachyonic production of Higgs particles. These produced Higgs particles would then share their energy with gauge bosons, potentially indicating thermalization. Since the model entails different non-perturbative effects, it is necessary to resort to numerical and semi-classical techniques. However, simulations require significant costs in terms of time and computational resources depending on the model used. Particularly, when $SU(2)$ gauge interactions are introduced, this becomes evident as the gauge field redistributes particle energies through rescattering processes, leading to an abundance of UV modes that disrupt simulation stability. This necessitates very small lattice spacings, resulting in exceedingly long simulation runtimes. Furthermore, the late-time behavior of preheating dynamics exhibits a universal form by wave kinetic theory. Therefore, we analyze patterns in the flow of particle numbers and predict future behavior using CNN-LSTM (Convolutional Neural Network combined with Long Short-Term Memory) time series analysis. In this way, we can reduce our dependence on simulations by orders of magnitude in terms of time and computational resources., Comment: 13 pages, 5 figures; references added

Interconnecting power converters (IPC) are the main elements enabling the interconnection of multiple high-voltage alternating current (HVAC) and high-voltage direct current (HVDC) subgrids. These converters can be classified either as grid-forming or grid-following. These roles can be assigned to both ac and dc terminals. This work compares state-of-the-art single-port grid-forming and grid-following control schemes with a dual-port grid-forming control scheme, which can simultaneously form a stable voltage on the ac and the dc sides. The dual-port grid-forming small-signal stability and dynamic behavior under fluctuations in the power flow are studied and compared against state-of-the-art control architectures. Moreover, the dual-port control scheme is validated and tested on a down-scaled laboratory platform with several transient events., Comment: 10 pages, 17 figures, submitted to IEEE Journal of Emerging and Selected Topics in Power Electronics

This work investigates interoperability and performance specifications for converter interfaced generation (CIG) that can be verified using only input-output data. First, we develop decentralized conditions on frequency stability that account for network circuit dynamics and can be verified using CIG terminal dynamics and a few key network parameters. Next, we formalize performance specifications that impose requirements on the CIG disturbance response. A simple data-driven validation method is presented that enables verification of the interoperability and performance specifications for CIG using input-output data from a two-node system. Data obtained from electromagnetic transient (EMT) simulations are used to illustrate the proposed approach and the impact of key parameters such as inner control loop gains, network coupling strength, and controller bandwidth limitations.

Many search-based quantum algorithms that achieve a theoretical speedup are not practically relevant since they require extraordinarily long coherence times, or lack the parallelizability of their classical counterparts.This raises the question of how to divide computational tasks into a collection of parallelizable sub-problems, each of which can be solved by a quantum computer with limited coherence time. Here, we approach this question via hybrid algorithms for the k-SAT problem. Our analysis is based on Sch\"oning's algorithm, which solves instances of k-SAT by performing random walks in the space of potential assignments. The search space of the walk allows for "natural" partitions, where we subject only one part of the partition to a Grover search, while the rest is sampled classically, thus resulting in a hybrid scheme. In this setting, we argue that there exists a simple trade-off relation between the total runtime and the coherence-time, which no such partition based hybrid-scheme can surpass. For several concrete choices of partitions, we explicitly determine the specific runtime coherence-time relations, and show saturation of the ideal trade-off. Finally, we present numerical simulations which suggest additional flexibility in implementing hybrid algorithms with optimal trade-off., Comment: 31 pages, 8 figures

Repeating a gate sequence multiple times amplifies systematic errors coherently, making it a useful tool for characterizing quantum gates. However, the precision of such an approach is limited by low-frequency noises, while its efficiency hindered by time-consuming scans required to match up the phases of the off-diagonal matrix elements being amplified. Here, we overcome both challenges by interleaving the gate of interest with dynamical decoupling sequences in a protocol we call Matrix-Element Amplification using Dynamical Decoupling (MEADD). Using frequency-tunable superconducting qubits from a Google Sycamore quantum processor, we experimentally demonstrate that MEADD surpasses the accuracy and precision of existing characterization protocols for estimating systematic errors in single- and two-qubit gates. In particular, MEADD yields factors of 5 to 10 improvements in estimating coherent parameters of the $\mathrm{CZ}$ gates compared to existing methods, reaching a precision below one milliradian. We also use it to characterize coherent crosstalk in the processor which was previously too small to detect reliably.

Incorporating diffusion models in the image compression domain has the potential to produce realistic and detailed reconstructions, especially at extremely low bitrates. Previous methods focus on using diffusion models as expressive decoders robust to quantization errors in the conditioning signals, yet achieving competitive results in this manner requires costly training of the diffusion model and long inference times due to the iterative generative process. In this work we formulate the removal of quantization error as a denoising task, using diffusion to recover lost information in the transmitted image latent. Our approach allows us to perform less than 10\% of the full diffusion generative process and requires no architectural changes to the diffusion model, enabling the use of foundation models as a strong prior without additional fine tuning of the backbone. Our proposed codec outperforms previous methods in quantitative realism metrics, and we verify that our reconstructions are qualitatively preferred by end users, even when other methods use twice the bitrate.

Secret key generation (SKG) between authenticated devices is a pivotal task for secure communications. Diffie-Hellman (DH) is de-facto standard but not post-quantum secure. In this paper, we shall invent and analyze a new security primitive that is specifically designed for WPAN. For WPAN, wireless channel-based SKG has been proposed but was not widely deployed due to its critical dependence on the channel's entropy which is uncontrollable. We formulate a different approach: We still exploit channel properties but mainly hinge on the reciprocity of the wireless channel and not on the channel's entropy. The radio advantage comes from the use of full duplex communication. We show that in this situation both legitimate parties can agree on a common secret key even without ever probing the channel at all. At the core is a new bisparse blind deconvolution scheme for which we prove correctness and information-theoretic, i.e. perfect, security. We show that, ultimately, a secret key can be extracted and give a lower bound for the number of secret key bits which is then verified by experiments.

In this note the use of the zero degree non-central chi squared distribution as predictive distribution for ensemble postprocessing is investigated. It has a point mass at zero by definition, and is thus particularly suited for postprocessing weather variables naturally exhibiting large numbers of zeros, such as precipitation, solar radiation or lightnings. Due to the properties of the distribution no additional truncation or censoring is required to obtain a positive probability at zero. The presented study investigates its performance compared to that of the censored generalized extreme value distribution and the censored and shifted gamma distribution for postprocessing 24h accumulated precipitation using an EMOS (ensemble model output statistics) approach with a rolling training period. The obtained results support the conclusion that it serves well as a predictive distribution in postprocessing precipitation and thus may also be considered in future analyses of other weather variables having substantial zero observations.

We study stationary points of the bending energy of curves $\gamma\colon[a,b]\to\mathbb{R}^n$ subject to constraints on the arc-length and total torsion while simultaneously allowing for a variable bending stiffness along the arc-length of the curve. Physically, this can be understood as a model for an elastic wire with isotropic cross-section of varying thickness. We derive the corresponding Euler-Lagrange equations for variations that are compactly supported away from the end points thus obtaining characterizations for elastic curves with variable bending stiffness. Moreover, we provide a collection of alternative characterizations, e.g., in terms of the curvature function. Adding to numerous known results relating elastic curves to dynamics, we establish connections between elastic curves with variable bending stiffness and damped pendulums and the flow of vortex filaments with finite thickness.