Search

High-quality, stable child care and early education (CCEE) can have lasting, positive impacts on children. However, there are ongoing challenges in recruiting, supporting, and retaining a qualified, stable CCEE workforce that provides high-quality care. CCEE educators typically have low levels of compensation; limited opportunities for education, training, and professional development; inconsistent working conditions; and high levels of stress and burnout. There are also high rates of job turnover, which can diminish the quality of care by straining remaining educators. The COVID-19 pandemic has exacerbated these issues. While several states and localities are taking steps to build and stabilize their CCEE workforce, important questions remain about how to best strengthen the workforce to meet the needs of children and families, particularly those who experience poverty or who are racially, ethnically, and linguistically diverse. The "Building and Sustaining the Child Care and Early Education Workforce" (BASE) project team completed a literature review and an environmental scan that were designed to identify and document existing knowledge about the CCEE workforce and develop strategies to strengthen it. The literature review synthesized research on factors that shape CCEE workforce dynamics, defined here as how educators enter, advance in, and exit out of different roles, settings, and types of care. The literature review predominantly focused on studies conducted between 2017 and 2021 and examined the effectiveness of strategies that were implemented to build a sustained, qualified workforce. The environmental scan identified and reviewed the range of strategies currently being used across the country to build, advance, and sustain the CCEE workforce. The team also completed a data scan that assessed the strengths and weaknesses of several potential data sources that could be used to examine workforce dynamics and address key gaps in existing research.

Child care and early education (CCEE) are essential resources for families and children across the country. Yet qualified educators are choosing to leave their positions, and young professionals are choosing not to enter the field. This instability has been a long-lasting issue and is thought to be driven largely by structural and systemic forces that shape the everyday experiences of the CCEE workforce. These issues have been exacerbated by the COVID-19 pandemic. This report lays out a conceptual framework to serve as a guide for researchers, policymakers, and administrators who are conducting research on the CCEE workforce and who are designing and implementing strategies to improve entry, retention, turnover, and advancement of the workforce. This report is also intended to inform how the field can work to build and sustain this critical workforce. The conceptual framework consists of three main components that are intended to provide a clear understanding of factors that can disrupt the stability of the CCEE workforce pipeline. By articulating the main components, the conceptual framework encourages researchers, policymakers, and administrators to consider a range of multilevel influences on workforce dynamics when designing strategies and when evaluating whether strategies are working as intended. This framework also aims to underscore that the individuals who make up the workforce--many of whom have been marginalized due to race, ethnicity, social class, and gender--interact with broader social, political, and cultural contexts that shape economic and educational policies, structures, and opportunities.

Numerical homogenization methods aim at providing appropriate coarse-scale approximations of solutions to (elliptic) partial differential equations that involve highly oscillatory coefficients. The localized orthogonal decomposition (LOD) method is an effective way of dealing with such coefficients, especially if they are non-periodic and non-smooth. It modifies classical finite element basis functions by suitable fine-scale corrections. In this paper, we make use of the structure of the LOD method, but we propose to calculate the corrections based on a Deep Ritz approach involving a parametrization of the coefficients to tackle temporal variations or uncertainties. Numerical examples for a parabolic model problem are presented to assess the performance of the approach.

We study the use of cell resampling to reduce the fraction of negatively weighted Monte Carlo events in a generated sample typical of that used in experimental analyses. To this end, we apply the Cell Resampler to a set of $pp \rightarrow \gamma \gamma + \mathrm{jets}$ shower-merged NLO matched events, describing the diphoton background to Higgs boson production, generated using the FxFx and MEPS@NLO merging procedures and showered using the Pythia and Sherpa parton shower algorithms. We discuss the impact on various kinematic distributions.

With over 3 billion users globally, mobile instant messaging apps have become indispensable for both personal and professional communication. Besides plain messaging, many services implement additional features such as delivery and read receipts informing a user when a message has successfully reached its target. This paper highlights that delivery receipts can pose significant privacy risks to users. We use specifically crafted messages that trigger delivery receipts allowing any user to be pinged without their knowledge or consent. By using this technique at high frequency, we demonstrate how an attacker could extract private information such as the online and activity status of a victim, e.g., screen on/off. Moreover, we can infer the number of currently active user devices and their operating system, as well as launch resource exhaustion attacks, such as draining a user's battery or data allowance, all without generating any notification on the target side. Due to the widespread adoption of vulnerable messengers (WhatsApp and Signal) and the fact that any user can be targeted simply by knowing their phone number, we argue for a design change to address this issue.

Collimator detection remains a challenging task in X-ray systems with unreliable or non-available information about the detectors position relative to the source. This paper presents a physically motivated image processing pipeline for simulating the characteristics of collimator shadows in X-ray images. By generating randomized labels for collimator shapes and locations, incorporating scattered radiation simulation, and including Poisson noise, the pipeline enables the expansion of limited datasets for training deep neural networks. We validate the proposed pipeline by a qualitative and quantitative comparison against real collimator shadows. Furthermore, it is demonstrated that utilizing simulated data within our deep learning framework not only serves as a suitable substitute for actual collimators but also enhances the generalization performance when applied to real-world data.

Reservoir computing - information processing based on untrained recurrent neural networks with random connections - is expected to depend on the nonlinear properties of the neurons and the resulting oscillatory, chaotic, or fixpoint dynamics of the network. However, the required degree of nonlinearity and the range of suitable dynamical regimes for a given task are not fully understood. To clarify these questions, we study the accuracy of a reservoir computer in artificial classification tasks of varying complexity, while tuning the neuron's degree of nonlinearity and the reservoir's dynamical regime. We find that, even for activation functions with extremely reduced nonlinearity, weak recurrent interactions and small input signals, the reservoir is able to compute useful representations, detectable only in higher order principal components, that render complex classificiation tasks linearly separable for the readout layer. When increasing the recurrent coupling, the reservoir develops spontaneous dynamical behavior. Nevertheless, the input-related computations can 'ride on top' of oscillatory or fixpoint attractors without much loss of accuracy, whereas chaotic dynamics reduces task performance more drastically. By tuning the system through the full range of dynamical phases, we find that the accuracy peaks both at the oscillatory/chaotic and at the chaotic/fixpoint phase boundaries, thus supporting the 'edge of chaos' hypothesis. Our results, in particular the robust weakly nonlinear operating regime, may offer new perspectives both for technical and biological neural networks with random connectivity.

Finite element methods typically require a high resolution to satisfactorily approximate micro and even macro patterns of an underlying physical model. This issue can be circumvented by appropriate numerical homogenization or multiscale strategies that are able to obtain reasonable approximations on under-resolved scales. In this paper, we study the implicit neural representation and propose a continuous super-resolution network as a numerical homogenization strategy. It can take coarse finite element data to learn both in-distribution and out-of-distribution high-resolution finite element predictions. Our highlight is the design of a local implicit transformer, which is able to learn multiscale features. We also propose Gabor wavelet-based coordinate encodings which can overcome the bias of neural networks learning low-frequency features. Finally, perception is often preferred over distortion so scientists can recognize the visual pattern for further investigation. However, implicit neural representation is known for its lack of local pattern supervision. We propose to use stochastic cosine similarities to compare the local feature differences between prediction and ground truth. It shows better performance on structural alignments. Our experiments show that our proposed strategy achieves superior performance as an in-distribution and out-of-distribution super-resolution strategy., Comment: 13 pages, 10 figures

We provide the first method allowing to retrieve spaceborne SIF maps at 30 m ground resolution with a strong correlation ($r^2=0.6$) to high-quality airborne estimates of sun-induced fluorescence (SIF). SIF estimates can provide explanatory information for many tasks related to agricultural management and physiological studies. While SIF products from airborne platforms are accurate and spatially well resolved, the data acquisition of such products remains science-oriented and limited to temporally constrained campaigns. Spaceborne SIF products on the other hand are available globally with often sufficient revisit times. However, the spatial resolution of spaceborne SIF products is too small for agricultural applications. In view of ESA's upcoming FLEX mission we develop a method for SIF retrieval in the O$_2$-A band of hyperspectral DESIS imagery to provide first insights for spaceborne SIF retrieval at high spatial resolution. To this end, we train a simulation-based self-supervised network with a novel perturbation based regularizer and test performance improvements under additional supervised regularization of atmospheric variable prediction. In a validation study with corresponding HyPlant derived SIF estimates at 740 nm we find that our model reaches a mean absolute difference of 0.78 mW / nm / sr / m$^2$., Comment: submitted to ECCV CVPPA 2024, 14 pages, 8 figures

Current interactive segmentation approaches, inspired by the success of META's Segment Anything model, have achieved notable advancements, however, they come with substantial limitations that hinder their practical application in real clinical scenarios. These include unrealistic human interaction requirements, such as slice-by-slice operations for 2D models on 3D data, a lack of iterative refinement, and insufficient evaluation experiments. These shortcomings prevent accurate assessment of model performance and lead to inconsistent outcomes across studies. IntRaBench overcomes these challenges by offering a comprehensive and reproducible framework for evaluating interactive segmentation methods in realistic, clinically relevant scenarios. It includes diverse datasets, target structures, and segmentation models, and provides a flexible codebase that allows seamless integration of new models and prompting strategies. Additionally, we introduce advanced techniques to minimize clinician interaction, ensuring fair comparisons between 2D and 3D models. By open-sourcing IntRaBench, we invite the research community to integrate their models and prompting techniques, ensuring continuous and transparent evaluation of interactive segmentation models in 3D medical imaging., Comment: Undergoing Peer-Review

Most datasets in the field of document analysis utilize highly standardized labels, which, while simplifying specific tasks, often produce outputs that are not directly applicable to humanities research. In contrast, the Nuremberg Letterbooks dataset, which comprises historical documents from the early 15th century, addresses this gap by providing multiple types of transcriptions and accompanying metadata. This approach allows for developing methods that are more closely aligned with the needs of the humanities. The dataset includes 4 books containing 1711 labeled pages written by 10 scribes. Three types of transcriptions are provided for handwritten text recognition: Basic, diplomatic, and regularized. For the latter two, versions with and without expanded abbreviations are also available. A combination of letter ID and writer ID supports writer identification due to changing writers within pages. In the technical validation, we established baselines for various tasks, demonstrating data consistency and providing benchmarks for future research to build upon.

How can we test AI performance? This question seems trivial, but it isn't. Standard benchmarks often have problems such as in-distribution and small-size test sets, oversimplified metrics, unfair comparisons, and short-term outcome pressure. As a consequence, good performance on standard benchmarks does not guarantee success in real-world scenarios. To address these problems, we present Touchstone, a large-scale collaborative segmentation benchmark of 9 types of abdominal organs. This benchmark is based on 5,195 training CT scans from 76 hospitals around the world and 5,903 testing CT scans from 11 additional hospitals. This diverse test set enhances the statistical significance of benchmark results and rigorously evaluates AI algorithms across various out-of-distribution scenarios. We invited 14 inventors of 19 AI algorithms to train their algorithms, while our team, as a third party, independently evaluated these algorithms on three test sets. In addition, we also evaluated pre-existing AI frameworks--which, differing from algorithms, are more flexible and can support different algorithms--including MONAI from NVIDIA, nnU-Net from DKFZ, and numerous other open-source frameworks. We are committed to expanding this benchmark to encourage more innovation of AI algorithms for the medical domain., Comment: Accepted to NeurIPS-2024

The self-assembly of pyridyl-functionalized triazine (T4PT) was studied on Au(111) using low-temperature scanning tunneling microscopy (STM) under ultra-high vacuum conditions combined with density functional theory (DFT) calculations. In particular, we investigated the effect of temperature on the intermolecular interactions within the assemblies. STM measurements revealed that T4PT molecules form a well-ordered, close-packed structure, with the molecules adopting a planar conformation parallel to the Au surface for coverages $\leq1$ monolayer upon room temperature deposition. The intermolecular interactions stabilizing the self-assembled arrangement is based on a combination of hydrogen bonding and weak van der Waals forces. Upon post-deposition annealing, the assemblies are additionally stabilized by metal-ligand bonding between the pyridyl ligands and native Au adatoms. Further post-deposition annealing at temperatures above $200^{\circ}$C led to the breaking of the N-Au bonds with the molecular assemblies transforming into a second close-packed hydrogen bonded structure. For temperatures exceeding $230^{\circ}$C, few covalently linked dimers formed, most likely as a result of CH-bond activation. We rationalize the kinetically-driven structure formation by unveiling the interaction strengths of the bonding motifs using DFT and compare the molecular conformation to the structurally similar pyridyl-functionalized benzene (T4PB).

Operator learning, the approximation of mappings between infinite-dimensional function spaces using ideas from machine learning, has gained increasing research attention in recent years. Approximate operators, learned from data, hold promise to serve as efficient surrogate models for problems in computational science and engineering, complementing traditional numerical methods. However, despite their empirical success, our understanding of the underpinning mathematical theory is in large part still incomplete. In this paper, we study the approximation of Lipschitz operators in expectation with respect to Gaussian measures. We prove higher Gaussian Sobolev regularity of Lipschitz operators and establish lower and upper bounds on the Hermite polynomial approximation error. We further consider the reconstruction of Lipschitz operators from $m$ arbitrary (adaptive) linear samples. A key finding is the tight characterization of the smallest achievable error for all possible (adaptive) sampling and reconstruction maps in terms of $m$. It is shown that Hermite polynomial approximation is an optimal recovery strategy, but we have the following curse of sample complexity: No method to approximate Lipschitz operators based on finitely many samples can achieve algebraic convergence rates in $m$. On the positive side, we prove that a sufficiently fast spectral decay of the covariance operator of the Gaussian measure guarantees convergence rates which are arbitrarily close to any algebraic rate in the large data limit $m \to \infty$. Finally, we focus on the recovery of Lipschitz operators from finitely many point samples. We consider Christoffel sampling and weighted least-squares approximation, and present an algorithm which provably achieves near-optimal sample complexity., Comment: 56 pages

Self-Supervised Learning (SSL) presents an exciting opportunity to unlock the potential of vast, untapped clinical datasets, for various downstream applications that suffer from the scarcity of labeled data. While SSL has revolutionized fields like natural language processing and computer vision, their adoption in 3D medical image computing has been limited by three key pitfalls: Small pre-training dataset sizes, architectures inadequate for 3D medical image analysis, and insufficient evaluation practices. We address these issues by i) leveraging a large-scale dataset of 44k 3D brain MRI volumes and ii) using a Residual Encoder U-Net architecture within the state-of-the-art nnU-Net framework. iii) A robust development framework, incorporating 5 development and 8 testing brain MRI segmentation datasets, allowed performance-driven design decisions to optimize the simple concept of Masked Auto Encoders (MAEs) for 3D CNNs. The resulting model not only surpasses previous SSL methods but also outperforms the strong nnU-Net baseline by an average of approximately 3 Dice points. Furthermore, our model demonstrates exceptional stability, achieving the highest average rank of 2 out of 7 methods, compared to the second-best method's mean rank of 3., Comment: Arxiv Preprint. Currently under Review

What representation do deep neural networks learn? How similar are images to each other for neural networks? Despite the overwhelming success of deep learning methods key questions about their internal workings still remain largely unanswered, due to their internal high dimensionality and complexity. To address this, one approach is to measure the similarity of activation responses to various inputs. Representational Similarity Matrices (RSMs) distill this similarity into scalar values for each input pair. These matrices encapsulate the entire similarity structure of a system, indicating which input leads to similar responses. While the similarity between images is ambiguous, we argue that the spatial location of semantic objects does neither influence human perception nor deep learning classifiers. Thus this should be reflected in the definition of similarity between image responses for computer vision systems. Revisiting the established similarity calculations for RSMs we expose their sensitivity to spatial alignment. In this paper, we propose to solve this through semantic RSMs, which are invariant to spatial permutation. We measure semantic similarity between input responses by formulating it as a set-matching problem. Further, we quantify the superiority of semantic RSMs over spatio-semantic RSMs through image retrieval and by comparing the similarity between representations to the similarity between predicted class probabilities., Comment: Accepted at NeurIPS2024

In the strong-coupling regime, the interaction between light and matter reaches a hybridization state where the photonic and material components become inseparably linked. Using tailored states of light to break symmetries in such systems can underpin the development of novel non-equilibrium quantum materials. Chiral optical cavities offer a promising way for this, enabling either temporal or spatial symmetry-breaking, both of which are unachievable with conventional mirror cavities. For spatial symmetry-breaking a cavity needs to discriminate the handedness of circularly polarized light, a functionality that can only be achieved with metamaterials. Here, we suggest and demonstrate experimentally a chiral transition metal dichalcogenide (TMDC) metasurface with broken out-of-plane symmetry, allowing for a selective formation of self-hybridized exciton-polaritons with specific chirality. Our metasurface cavity maintains maximum chirality for oblique incidence up to 20{\deg}, significantly outperforming all previously known designs, thereby turning the angle of incidence from a constraint to a new degree of freedom for sub-nanometer precise control of resonance wavelengths. Moreover, we study the chiral strong-coupling regime in nonlinear experiments and show the polariton-driven nature of chiral third-harmonic generation. Our results demonstrate a clear pathway towards novel quantum material engineering with implications in a wide range of photonics research, such as superconductivity and valleytronics., Comment: 34 pages, 4 figures, and 12 supporting figures

The XLZD collaboration is developing a two-phase xenon time projection chamber with an active mass of 60 to 80 t capable of probing the remaining WIMP-nucleon interaction parameter space down to the so-called neutrino fog. In this work we show that, based on the performance of currently operating detectors using the same technology and a realistic reduction of radioactivity in detector materials, such an experiment will also be able to competitively search for neutrinoless double beta decay in $^{136}$Xe using a natural-abundance xenon target. XLZD can reach a 3$\sigma$ discovery potential half-life of 5.7$\times$10$^{27}$ yr (and a 90% CL exclusion of 1.3$\times$10$^{28}$ yr) with 10 years of data taking, corresponding to a Majorana mass range of 7.3-31.3 meV (4.8-20.5 meV). XLZD will thus exclude the inverted neutrino mass ordering parameter space and will start to probe the normal ordering region for most of the nuclear matrix elements commonly considered by the community., Comment: 29 pages, 7 figures

This report describes the experimental strategy and technologies for a next-generation xenon observatory sensitive to dark matter and neutrino physics. The detector will have an active liquid xenon target mass of 60-80 tonnes and is proposed by the XENON-LUX-ZEPLIN-DARWIN (XLZD) collaboration. The design is based on the mature liquid xenon time projection chamber technology of the current-generation experiments, LZ and XENONnT. A baseline design and opportunities for further optimization of the individual detector components are discussed. The experiment envisaged here has the capability to explore parameter space for Weakly Interacting Massive Particle (WIMP) dark matter down to the neutrino fog, with a 3$\sigma$ evidence potential for the spin-independent WIMP-nucleon cross sections as low as $3\times10^{-49}\rm cm^2$ (at 40 GeV/c$^2$ WIMP mass). The observatory is also projected to have a 3$\sigma$ observation potential of neutrinoless double-beta decay of $^{136}$Xe at a half-life of up to $5.7\times 10^{27}$ years. Additionally, it is sensitive to astrophysical neutrinos from the atmosphere, sun, and galactic supernovae., Comment: 32 pages, 14 figures

Accurate detection and segmentation of cone cells in the retina are essential for diagnosing and managing retinal diseases. In this study, we used advanced imaging techniques, including confocal and non-confocal split detector images from adaptive optics scanning light ophthalmoscopy (AOSLO), to analyze photoreceptors for improved accuracy. Precise segmentation is crucial for understanding each cone cell's shape, area, and distribution. It helps to estimate the surrounding areas occupied by rods, which allows the calculation of the density of cone photoreceptors in the area of interest. In turn, density is critical for evaluating overall retinal health and functionality. We explored two U-Net-based segmentation models: StarDist for confocal and Cellpose for calculated modalities. Analyzing cone cells in images from two modalities and achieving consistent results demonstrates the study's reliability and potential for clinical application.

In this paper we examine the relativistic Einstein rings assuming a nonminimal coupling between gravitation and electromagnetism in a Reissner-Norstr\"om background. Starting from a general action of a nonminimal coupled electrodynamics we show that an unstable effective photon sphere may be obtained in the regime of eikonal approximation. Restricting ourselves to the unstable photon sphere domain we examine the expected angular positions of the first and second relativistic Einstein rings. To compare our results with previous studies in the literature we model the lens as a Galactic supermassive black hole. For fixed coupling parameters we show that such angular positions decrease as the charge parameter increases. The angular separation between the first and second rings is also evaluated. We show that such separation increases as the charge parameter increases. These patterns are not followed by nearly extremal configurations. In this case we show that there is an overlap domain so that the angular position and the corresponding coupling parameter do not allow one to differ extremal cases from complementary configurations which satisfy the cosmic censorship hypothesis., Comment: Important corrections included

This paper introduces a novel method for reconstructing cone beam computed tomography (CBCT) images for arbitrary orbits using a differentiable shift-variant filtered backprojection (FBP) neural network. Traditional CBCT reconstruction methods for arbitrary orbits, like iterative reconstruction algorithms, are computationally expensive and memory-intensive. The proposed method addresses these challenges by employing a shift-variant FBP algorithm optimized for arbitrary trajectories through a deep learning approach that adapts to a specific orbit geometry. This approach overcomes the limitations of existing techniques by integrating known operators into the learning model, minimizing the number of parameters, and improving the interpretability of the model. The proposed method is a significant advancement in interventional medical imaging, particularly for robotic C-arm CT systems, enabling faster and more accurate CBCT reconstructions with customized orbits. Especially this method can also be used for the analytical reconstruction of non-continuous orbits like circular plus arc. The experimental results demonstrate that the proposed method significantly accelerates the reconstruction process compared to conventional iterative algorithms. It achieves comparable or superior image quality, as evidenced by metrics such as the mean squared error (MSE), the peak signal-to-noise ratio (PSNR), and the structural similarity index measure (SSIM). The validation experiments show that the method can handle data from different trajectories, demonstrating its flexibility and robustness across different scan geometries. Our method demonstrates a significant improvement, particularly for the sinusoidal trajectory, achieving a 38.6% reduction in MSE, a 7.7% increase in PSNR, and a 5.0% improvement in SSIM. Furthermore, the computation time for reconstruction was reduced by more than 97%.

Superfluid ${}^4$He is an ideal candidate for the direct detection of light dark matter via nuclear recoils thanks to its low nuclear mass and the possibility to reach a low detection energy threshold by exploiting the generated quasiparticles. The design of future detectors based on this target, such as the DELight experiment, requires a proper understanding of the formation and partitioning of the signal for different energy depositions from various sources. This work presents an overview of the physical processes involved in the energy deposition of recoiling electrons and ions, and describes a Monte Carlo approach to the partitioning of the signal into different channels. Despite an overall good agreement with existing literature, differences in the region of interest for light dark matter searches below 200\,eV are observed., Comment: 14 pages, 16 figures, 1 table

Novel optical imaging techniques, such as hyperspectral imaging (HSI) combined with machine learning-based (ML) analysis, have the potential to revolutionize clinical surgical imaging. However, these novel modalities face a shortage of large-scale, representative clinical data for training ML algorithms, while preclinical animal data is abundantly available through standardized experiments and allows for controlled induction of pathological tissue states, which is not ethically possible in patients. To leverage this situation, we propose a novel concept called "xeno-learning", a cross-species knowledge transfer paradigm inspired by xeno-transplantation, where organs from a donor species are transplanted into a recipient species. Using a total of 11,268 HSI images from humans as well as porcine and rat models, we show that although spectral signatures of organs differ across species, shared pathophysiological mechanisms manifest as comparable relative spectral changes across species. Such changes learnt in one species can thus be transferred to a new species via a novel "physiology-based data augmentation" method, enabling the large-scale secondary use of preclinical animal data for humans. The resulting ethical, monetary, and performance benefits of the proposed knowledge transfer paradigm promise a high impact of the methodology on future developments in the field., Comment: Jan Sellner and Alexander Studier-Fischer contributed equally to this work

We present a comprehensive study on the formation of micrometer-sized, textured hexagonal diamond silicon (hd-Si) crystals via nanoindentation followed by annealing. Utilizing advanced characterization techniques such as polarized Raman spectroscopy, high-resolution transmission electron microscopy, and electron energy-loss spectroscopy, we demonstrate the successful transformation of silicon into high-quality hd-Si. The experimental results are further supported by first-principles calculations and molecular dynamics simulations. Notably, the hd-Si phase consists of nanometer-sized grains with slight misorientations, organized into large micrometer-scale textured domains. These findings underscore the potential of nanoindentation as a precise and versatile tool for inducing pressure-driven phase transformations, particularly for the stabilization of hexagonal silicon. The textured nature of hd-Si also presents a unique opportunity to tailor its optical properties, opening new avenues for its application in semiconductor and optoelectronic devices.

The first very long baseline interferometry (VLBI) detections at 870$\mu$m wavelength (345$\,$GHz frequency) are reported, achieving the highest diffraction-limited angular resolution yet obtained from the surface of the Earth, and the highest-frequency example of the VLBI technique to date. These include strong detections for multiple sources observed on inter-continental baselines between telescopes in Chile, Hawaii, and Spain, obtained during observations in October 2018. The longest-baseline detections approach 11$\,$G$\lambda$ corresponding to an angular resolution, or fringe spacing, of 19$\mu$as. The Allan deviation of the visibility phase at 870$\mu$m is comparable to that at 1.3$\,$mm on the relevant integration time scales between 2 and 100$\,$s. The detections confirm that the sensitivity and signal chain stability of stations in the Event Horizon Telescope (EHT) array are suitable for VLBI observations at 870$\mu$m. Operation at this short wavelength, combined with anticipated enhancements of the EHT, will lead to a unique high angular resolution instrument for black hole studies, capable of resolving the event horizons of supermassive black holes in both space and time., Comment: Corresponding author: S. Doeleman

As a step towards the ultimate goal of a high-precision mass measurement of doubly-magic $^{100}$Sn, the mass of $^{103}$Sn was measured at the Low Energy Beam and Ion Trap (LEBIT) located at the Facility for Rare Isotope Beams (FRIB). Utilizing the time-of-flight ion cyclotron resonance (ToF-ICR) technique, a mass uncertainty of 3.7~keV was achieved, an improvement by more than an order of magnitude compared to a recent measurement performed in 2023 at the Cooler Storage Ring (CSRe) in Lanzhou. Although the LEBIT and CSRe mass measurements of $^{103}$Sn are in agreement, they diverge from the experimental mass value reported in the 2016 version of the Atomic Mass Evaluation (AME2016), which was derived from the measured $Q_{\beta^+}$ value and the mass of $^{103}$In. In AME2020, this indirectly measured $^{103}$Sn mass was classified as a `seriously irregular mass' and replaced with an extrapolated value, which aligns with the most recent measured values from CSRe and LEBIT. As such, the smoothness of the mass surface is confidently reestablished for $^{103}$Sn. Furthermore, LEBIT's mass measurement of $^{103}$Sn enabled a significant reduction in the mass uncertainties of five parent isotopes which are now dominated by uncertainties in their respective $Q$-values.

Nanostructured high-index dielectrics have shown great promise as low-loss photonic platforms for wavefront control and enhancing optical nonlinearities. However, their potential as optomechanical resonators has remained unexplored. In this work, we investigate the generation and detection of coherent acoustic phonons in individual crystalline gallium phosphide nanodisks on silica in a pump-probe configuration. By pumping the dielectric above its bandgap energy and probing over its transparent region, we observe the radial breathing mode of the disk with an oscillation frequency around 10 GHz. We analyze the performance of nanoantennas of various sizes in the 300-600 nm diameter range at fixed 125 nm height and find that the detection efficiency is maximum near the fundamental anapole state, in agreement with numerical simulations. By comparing with reference gold nanodisk and nanorod plasmonic resonators, we find that the dielectric nanoantennas display a modulation amplitude up to ~5 times larger. We further demonstrate the launching of acoustic waves through the underlaying substrate and the mechanical coupling between two nanostructures placed 3 {\mu}m apart, laying the basis for photonic-phononic signal processing using dielectric nanoantennas.

Phase-change materials (PCMs) are increasingly recognised as promising platforms for tunable photonic devices due to their ability to modulate optical properties through solid-state phase transitions. Ultrathin and low-loss PCMs are highly valued for their fast and more effective phase transitions and applications in reconfigurable photonic chips, metasurfaces, optical modulators, sensors, photonic memories, and neuromorphic computing. However, conventional PCMs such as GST, GSST, VO2, and In3SbTe2, despite optimisation for tunable meta-optics, suffer from high intrinsic losses in the near-infrared (NIR) region, limiting their potential for high quality factor (Q-factor) resonant metasurfaces. Here we present the design and fabrication of tunable bound states in the continuum (BIC) metasurfaces using the ultralow-loss PCM Sb2Se3. Our BIC metasurfaces, only 25 nm thick, achieve high modulation depth and broad resonance tuning in the NIR with high Q-factors up to 130, without the need for additional materials. Experimentally, we employ these BIC metasurfaces to modulate photoluminescence in rare earth-doped upconversion nanoparticles, reducing the excitation power for multiphoton photoluminescence and enabling emission polarisation manipulation. This work offers a promising platform for developing active resonant metasurfaces in the NIR region, with broad applications including super resolution imaging, optical modulation, ultrafast switches, harmonic generation, colour filtering, and optical sensing.

We present a novel deep learning pipeline to perform a model-independent, likelihood-free search for anomalous (i.e., non-background) events in the proposed next generation multi-ton scale liquid Xenon-based direct detection experiment, DARWIN. We train an anomaly detector comprising a variational autoencoder and a classifier on extensive, high-dimensional simulated detector response data and construct a one-dimensional anomaly score optimised to reject the background only hypothesis in the presence of an excess of non-background-like events. We benchmark the procedure with a sensitivity study that determines its power to reject the background-only hypothesis in the presence of an injected WIMP dark matter signal, outperforming the classical, likelihood-based background rejection test. We show that our neural networks learn relevant energy features of the events from low-level, high-dimensional detector outputs, without the need to compress this data into lower-dimensional observables, thus reducing computational effort and information loss. For the future, our approach lays the foundation for an efficient end-to-end pipeline that eliminates the need for many of the corrections and cuts that are traditionally part of the analysis chain, with the potential of achieving higher accuracy and significant reduction of analysis time., Comment: 10 Figures, 3 Tables, 23 Pages (incl. references)

Speech pathology has impacts on communication abilities and quality of life. While deep learning-based models have shown potential in diagnosing these disorders, the use of sensitive data raises critical privacy concerns. Although differential privacy (DP) has been explored in the medical imaging domain, its application in pathological speech analysis remains largely unexplored despite the equally critical privacy concerns. This study is the first to investigate DP's impact on pathological speech data, focusing on the trade-offs between privacy, diagnostic accuracy, and fairness. Using a large, real-world dataset of 200 hours of recordings from 2,839 German-speaking participants, we observed a maximum accuracy reduction of 3.85% when training with DP with a privacy budget, denoted by {\epsilon}, of 7.51. To generalize our findings, we validated our approach on a smaller dataset of Spanish-speaking Parkinson's disease patients, demonstrating that careful pretraining on large-scale task-specific datasets can maintain or even improve model accuracy under DP constraints. We also conducted a comprehensive fairness analysis, revealing that reasonable privacy levels (2<{\epsilon}<10) do not introduce significant gender bias, though age-related disparities may require further attention. Our results suggest that DP can effectively balance privacy and utility in speech disorder detection, but also highlight the unique challenges in the speech domain, particularly regarding the privacy-fairness trade-off. This provides a foundation for future work to refine DP methodologies and address fairness across diverse patient groups in real-world deployments.

Medical imaging is spearheading the AI transformation of healthcare. Performance reporting is key to determine which methods should be translated into clinical practice. Frequently, broad conclusions are simply derived from mean performance values. In this paper, we argue that this common practice is often a misleading simplification as it ignores performance variability. Our contribution is threefold. (1) Analyzing all MICCAI segmentation papers (n = 221) published in 2023, we first observe that more than 50% of papers do not assess performance variability at all. Moreover, only one (0.5%) paper reported confidence intervals (CIs) for model performance. (2) To address the reporting bottleneck, we show that the unreported standard deviation (SD) in segmentation papers can be approximated by a second-order polynomial function of the mean Dice similarity coefficient (DSC). Based on external validation data from 56 previous MICCAI challenges, we demonstrate that this approximation can accurately reconstruct the CI of a method using information provided in publications. (3) Finally, we reconstructed 95% CIs around the mean DSC of MICCAI 2023 segmentation papers. The median CI width was 0.03 which is three times larger than the median performance gap between the first and second ranked method. For more than 60% of papers, the mean performance of the second-ranked method was within the CI of the first-ranked method. We conclude that current publications typically do not provide sufficient evidence to support which models could potentially be translated into clinical practice., Comment: Paper accepted at MICCAI 2024 conference

Accurate segmentation of Multiple Sclerosis (MS) lesions in longitudinal MRI scans is crucial for monitoring disease progression and treatment efficacy. Although changes across time are taken into account when assessing images in clinical practice, most existing deep learning methods treat scans from different timepoints separately. Among studies utilizing longitudinal images, a simple channel-wise concatenation is the primary albeit suboptimal method employed to integrate timepoints. We introduce a novel approach that explicitly incorporates temporal differences between baseline and follow-up scans through a unique architectural inductive bias called Difference Weighting Block. It merges features from two timepoints, emphasizing changes between scans. We achieve superior scores in lesion segmentation (Dice Score, Hausdorff distance) as well as lesion detection (lesion-level $F_1$ score) as compared to state-of-the-art longitudinal and single timepoint models across two datasets. Our code is made publicly available at www.github.com/MIC-DKFZ/Longitudinal-Difference-Weighting., Comment: Accepted at MICCAI 2024 LDTM

Digitizing 3D static scenes and 4D dynamic events from multi-view images has long been a challenge in computer vision and graphics. Recently, 3D Gaussian Splatting (3DGS) has emerged as a practical and scalable reconstruction method, gaining popularity due to its impressive reconstruction quality, real-time rendering capabilities, and compatibility with widely used visualization tools. However, the method requires a substantial number of input views to achieve high-quality scene reconstruction, introducing a significant practical bottleneck. This challenge is especially severe in capturing dynamic scenes, where deploying an extensive camera array can be prohibitively costly. In this work, we identify the lack of spatial autocorrelation of splat features as one of the factors contributing to the suboptimal performance of the 3DGS technique in sparse reconstruction settings. To address the issue, we propose an optimization strategy that effectively regularizes splat features by modeling them as the outputs of a corresponding implicit neural field. This results in a consistent enhancement of reconstruction quality across various scenarios. Our approach effectively handles static and dynamic cases, as demonstrated by extensive testing across different setups and scene complexities., Comment: ECCV 2024 paper. The project page and code are available at https://markomih.github.io/SplatFields/

Social networks shape individuals' lives, influencing everything from career paths to health. This paper presents a registry-based, multi-layer and temporal network of the entire Danish population in the years 2008-2021 (roughly 7.2 mill. individuals). Our network maps the relationships formed through family, households, neighborhoods, colleagues and classmates. We outline key properties of this multiplex network, introducing both an individual-focused perspective as well as a bipartite representation. We show how to aggregate and combine the layers, and how to efficiently compute network measures such as shortest paths in large administrative networks. Our analysis reveals how past connections reappear later in other layers, that the number of relationships aggregated over time reflects the position in the income distribution, and that we can recover canonical shortest path length distributions when appropriately weighting connections. Along with the network data, we release a Python package that uses the bipartite network representation for efficient analysis.

Segmentation of the fetal and maternal structures, particularly intrapartum ultrasound imaging as advocated by the International Society of Ultrasound in Obstetrics and Gynecology (ISUOG) for monitoring labor progression, is a crucial first step for quantitative diagnosis and clinical decision-making. This requires specialized analysis by obstetrics professionals, in a task that i) is highly time- and cost-consuming and ii) often yields inconsistent results. The utility of automatic segmentation algorithms for biometry has been proven, though existing results remain suboptimal. To push forward advancements in this area, the Grand Challenge on Pubic Symphysis-Fetal Head Segmentation (PSFHS) was held alongside the 26th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2023). This challenge aimed to enhance the development of automatic segmentation algorithms at an international scale, providing the largest dataset to date with 5,101 intrapartum ultrasound images collected from two ultrasound machines across three hospitals from two institutions. The scientific community's enthusiastic participation led to the selection of the top 8 out of 179 entries from 193 registrants in the initial phase to proceed to the competition's second stage. These algorithms have elevated the state-of-the-art in automatic PSFHS from intrapartum ultrasound images. A thorough analysis of the results pinpointed ongoing challenges in the field and outlined recommendations for future work. The top solutions and the complete dataset remain publicly available, fostering further advancements in automatic segmentation and biometry for intrapartum ultrasound imaging.

The third autoPET challenge introduced a new data-centric task this year, shifting the focus from model development to improving metastatic lesion segmentation on PET/CT images through data quality and handling strategies. In response, we developed targeted methods to enhance segmentation performance tailored to the characteristics of PET/CT imaging. Our approach encompasses two key elements. First, to address potential alignment errors between CT and PET modalities as well as the prevalence of punctate lesions, we modified the baseline data augmentation scheme and extended it with misalignment augmentation. This adaptation aims to improve segmentation accuracy, particularly for tiny metastatic lesions. Second, to tackle the variability in image dimensions significantly affecting the prediction time, we implemented a dynamic ensembling and test-time augmentation (TTA) strategy. This method optimizes the use of ensembling and TTA within a 5-minute prediction time limit, effectively leveraging the generalization potential for both small and large images. Both of our solutions are designed to be robust across different tracers and institutional settings, offering a general, yet imaging-specific approach to the multi-tracer and multi-institutional challenges of the competition. We made the challenge repository with our modifications publicly available at \url{https://github.com/MIC-DKFZ/miccai2024_autopet3_datacentric}., Comment: Contribution to the data-centric task of the autoPET III Challenge 2024

Automated lesion segmentation in PET/CT scans is crucial for improving clinical workflows and advancing cancer diagnostics. However, the task is challenging due to physiological variability, different tracers used in PET imaging, and diverse imaging protocols across medical centers. To address this, the autoPET series was created to challenge researchers to develop algorithms that generalize across diverse PET/CT environments. This paper presents our solution for the autoPET III challenge, targeting multitracer, multicenter generalization using the nnU-Net framework with the ResEncL architecture. Key techniques include misalignment data augmentation and multi-modal pretraining across CT, MR, and PET datasets to provide an initial anatomical understanding. We incorporate organ supervision as a multitask approach, enabling the model to distinguish between physiological uptake and tracer-specific patterns, which is particularly beneficial in cases where no lesions are present. Compared to the default nnU-Net, which achieved a Dice score of 57.61, or the larger ResEncL (65.31) our model significantly improved performance with a Dice score of 68.40, alongside a reduction in false positive (FPvol: 7.82) and false negative (FNvol: 10.35) volumes. These results underscore the effectiveness of combining advanced network design, augmentation, pretraining, and multitask learning for PET/CT lesion segmentation. After evaluation on the test set, our approach was awarded the first place in the model-centric category (Team LesionTracer). Code is publicly available at https://github.com/MIC-DKFZ/autopet-3-submission., Comment: Winning method of the autoPET III challenge (model-centric) - Team LesionTracer

Cone-beam computed tomography (CBCT) is widely used in interventional surgeries and radiation oncology. Due to the limited size of flat-panel detectors, anatomical structures might be missing outside the limited field-of-view (FOV), which restricts the clinical applications of CBCT systems. Recently, deep learning methods have been proposed to extend the FOV for multi-slice CT systems. However, in mobile CBCT system with a smaller FOV size, projection data is severely truncated and it is challenging for a network to restore all missing structures outside the FOV. In some applications, only certain structures outside the FOV are of interest, e.g., ribs in needle path planning for liver/lung cancer diagnosis. Therefore, a task-specific data preparation method is proposed in this work, which automatically let the network focus on structures of interest instead of all the structures. Our preliminary experiment shows that Pix2pixGAN with a conventional training has the risk to reconstruct false positive and false negative rib structures from severely truncated CBCT data, whereas Pix2pixGAN with the proposed task-specific training can reconstruct all the ribs reliably. The proposed method is promising to empower CBCT with more clinical applications., Comment: Published in the CT-Meeting 2024 proceeding. arXiv admin note: text overlap with arXiv:2108.13844

I present an algorithm for the reconstruction of multivariate rational functions from black-box probes. The arguably most important application in high-energy physics is the calculation of multi-loop and multi-leg amplitudes, where rational functions appear as coefficients in the integration-by-parts reduction to basis integrals. I show that for a dense coefficient the algorithm is nearly optimal, in the sense that the number of required probes is close to the number of unknowns., Comment: 12 pages, no figures

We use a combinatorial approach to obtain exact expressions for the many-body density of states of fermionic and bosonic gases with equally spaced single-particle spectra. We identify a mapping that reveals a remarkable property, namely, fermionic and bosonic gases have the same many-body density of states, up to a shift corresponding to ground state energy. Additionally, we show that there is a regime, comprising the validity range of the Bethe approximation, where the many-body density of states becomes independent of the number of particles.

Twisted optical fibers are a promising platform for manipulating circularly polarized light and orbital angular momentum beams for applications such as nonlinear frequency conversion, optical communication, or chiral sensing. However, integration into chip-scale technology is challenging because twisted fibers are incompatible with planar photonics and the achieved twist rates are limited. Here, we address these challenges by introducing the concept of 3D-nanoprinted on-chip twisted hollow-core light cages. We show theoretically and experimentally that geometrical twisting of light cages forces the fundamental core mode of a given handedness to couple with selected higher-order core modes, resulting in strong circular dichroism (CD). These chiral resonances result from the angular momentum harmonics of the fundamental mode, allowing us to predict their spectral locations and the occurrence of circular birefringence. Twisted light cages enable very high twist rates and CD, exceeding those of twisted hollow-core fibers by more than two orders of magnitude (twist period: 90 $\mu$m, CD: 0.8 dB/mm). Moreover, the unique cage design provides lateral access to the central core region, enabling future applications in chiral spectroscopy. Therefore, the presented concept opens a path for translating twisted fiber research to on-chip technology, resulting in a new platform for integrated chiral photonics., Comment: Main text (46 pages, 7 figures) and Supplemental Material (28 pages, 19 figures)

Hyperspectral imaging (HSI) is emerging as a promising novel imaging modality with various potential surgical applications. Currently available cameras, however, suffer from poor integration into the clinical workflow because they require the lights to be switched off, or the camera to be manually recalibrated as soon as lighting conditions change. Given this critical bottleneck, the contribution of this paper is threefold: (1) We demonstrate that dynamically changing lighting conditions in the operating room dramatically affect the performance of HSI applications, namely physiological parameter estimation, and surgical scene segmentation. (2) We propose a novel learning-based approach to automatically recalibrating hyperspectral images during surgery and show that it is sufficiently accurate to replace the tedious process of white reference-based recalibration. (3) Based on a total of 742 HSI cubes from a phantom, porcine models, and rats we show that our recalibration method not only outperforms previously proposed methods, but also generalizes across species, lighting conditions, and image processing tasks. Due to its simple workflow integration as well as high accuracy, speed, and generalization capabilities, our method could evolve as a central component in clinical surgical HSI., Comment: Oral at MICCAI 2024

The osmotic second virial coefficient B2 is an important parameter to describe the interactions and phase behavior of protein solutions, including colloidal systems and macromolecular solutions. Another key parameter to describe the driving force of the nucleation of a new phase is the supersaturation, which is used in the classical nucleation theory framework and is connected with the favorable contribution in the Gibbs free energy in the bulk solution. In this article, we establish a connection between B2 calculated from small angle Xray scattering (SAXS) data and the values of B2 obtained from supersaturation measurements using thermodynamics considerations. The values of the second virial coefficient calculated employing this method agree with those determined via SAXS in the region near the liquid liquid phase separation border for human serum albumin and bovine serum albumin. The general relations adopted are shown to be useful for the estimation of the second virial coefficient B2 for globular proteins, in the proximity of the binodal biphasic coexistent region., Comment: 9 pages, 3 figures

Providing more precise tissue attenuation information, synthetic computed tomography (sCT) generated from magnetic resonance imaging (MRI) contributes to improved radiation therapy treatment planning. In our study, we employ the advanced SwinUNETR framework for synthesizing CT from MRI images. Additionally, we introduce a three-dimensional subvolume merging technique in the prediction process. By selecting an optimal overlap percentage for adjacent subvolumes, stitching artifacts are effectively mitigated, leading to a decrease in the mean absolute error (MAE) between sCT and the labels from 52.65 HU to 47.75 HU. Furthermore, implementing a weight function with a gamma value of 0.9 results in the lowest MAE within the same overlap area. By setting the overlap percentage between 50% and 70%, we achieve a balance between image quality and computational efficiency.

Facial expression perception in humans inherently relies on prior knowledge and contextual cues, contributing to efficient and flexible processing. For instance, multi-modal emotional context (such as voice color, affective text, body pose, etc.) can prompt people to perceive emotional expressions in objectively neutral faces. Drawing inspiration from this, we introduce a novel approach for facial expression classification that goes beyond simple classification tasks. Our model accurately classifies a perceived face and synthesizes the corresponding mental representation perceived by a human when observing a face in context. With this, our model offers visual insights into its internal decision-making process. We achieve this by learning two independent representations of content and context using a VAE-GAN architecture. Subsequently, we propose a novel attention mechanism for context-dependent feature adaptation. The adapted representation is used for classification and to generate a context-augmented expression. We evaluate synthesized expressions in a human study, showing that our model effectively produces approximations of human mental representations. We achieve State-of-the-Art classification accuracies of 81.01% on the RAVDESS dataset and 79.34% on the MEAD dataset. We make our code publicly available., Comment: GCPR 2024

In non-relativistic physics the concepts of geometry and topology are usually applied to characterise spatial structures, or structures in momentum space. We introduce the concept of temporal geometry, which encompasses the geometric and topological properties of temporal shapes, i.e. trajectories traced by a tip of a time-dependent vector in vector space. We apply it to vectors of ultrafast electron current or induced polarization in chiral molecules. The central concepts of temporal geometry - curvature and connection - emerge as ubiquitous features of photoexcited, non-equilibrium, chiral electron dynamics. We demonstrate that curvature and connection (i) rely on the interplay of molecular chirality and the polarization properties of light pulses, (ii) can be introduced for multiphoton processes, and (iii) control enantio-sensitive geometric observables via non-equilibrium electronic dynamics excited by tailored laser fields. Our findings may open a way to ultrafast, topologically non-trivial, and enantio-sensitive chemical dynamics., Comment: 32 pages, 5 figures

Data-flow analyses like points-to analysis can vastly improve the precision of other analyses, and help perform powerful code optimizations. However, whole-program points-to analysis of large programs tend to be expensive - both in terms of time and memory. Consequently, many compilers (both static and JIT) and program-analysis tools tend to employ faster - but more conservative - points-to analysis to improve usability. As an alternative to such trading of precision for performance, various techniques have been proposed to perform precise yet expensive fixed-point points-to analyses ahead of time in a static analyzer, store the results, and then transmit them to independent compilation/program-analysis stages that may need them. However, an underlying concern of safety affects all such techniques - can a compiler (or program analysis tool) trust the points-to analysis results generated by another compiler/tool? In this work, we address this issue of trust, while keeping the issues of performance efficiency in mind. We propose ART: Analysis-results Representation Template - a novel scheme to efficiently and concisely encode results of flow-sensitive, context-insensitive points-to analysis computed by a static analyzer for use in any independent system that may benefit from such a highly precise points-to analysis. Our scheme has two components: (i) a producer that can statically perform expensive points-to analysis and encode the same concisely. (ii) a consumer that, on receiving such encoded results, can regenerate the points-to analysis results encoded by the artwork if it is deemed safe. We demonstrate the usage of ART by implementing a producer (in Soot) and two consumers (in Soot and the Eclipse OpenJ9 JIT compiler). We evaluate our implementation over various benchmarks from the DaCapo and SPECjvm2008 suites.

The imitation of cursive handwriting is mainly limited to generating handwritten words or lines. Multiple synthetic outputs must be stitched together to create paragraphs or whole pages, whereby consistency and layout information are lost. To close this gap, we propose a method for imitating handwriting at the paragraph level that also works for unseen writing styles. Therefore, we introduce a modified latent diffusion model that enriches the encoder-decoder mechanism with specialized loss functions that explicitly preserve the style and content. We enhance the attention mechanism of the diffusion model with adaptive 2D positional encoding and the conditioning mechanism to work with two modalities simultaneously: a style image and the target text. This significantly improves the realism of the generated handwriting. Our approach sets a new benchmark in our comprehensive evaluation. It outperforms all existing imitation methods at both line and paragraph levels, considering combined style and content preservation.

Selective Classification, wherein models can reject low-confidence predictions, promises reliable translation of machine-learning based classification systems to real-world scenarios such as clinical diagnostics. While current evaluation of these systems typically assumes fixed working points based on pre-defined rejection thresholds, methodological progress requires benchmarking the general performance of systems akin to the $\mathrm{AUROC}$ in standard classification. In this work, we define 5 requirements for multi-threshold metrics in selective classification regarding task alignment, interpretability, and flexibility, and show how current approaches fail to meet them. We propose the Area under the Generalized Risk Coverage curve ($\mathrm{AUGRC}$), which meets all requirements and can be directly interpreted as the average risk of undetected failures. We empirically demonstrate the relevance of $\mathrm{AUGRC}$ on a comprehensive benchmark spanning 6 data sets and 13 confidence scoring functions. We find that the proposed metric substantially changes metric rankings on 5 out of the 6 data sets.