Search

The nonparametric sign test dates back to the early 18th century with a data analysis by John Arbuthnot. It is an alternative to Gosset's more recent t-test for consistent differences between two sets of observations. Fisher's F-test is a generalization of the t-test to linear regression and linear null hypotheses. Only the sign test is robust to non-Gaussianity. Gutenbrunner et al. [1993] derived a version of the sign test for linear null hypotheses in the spirit of the F-test, which requires the difficult estimation of the sparsity function. We propose instead a new sign test called $\infty$-S test via the convex analysis of a point estimator that thresholds the estimate towards the null hypothesis of the test., Comment: 16 pages, 4 figures

Optic nerve head (ONH) detection has been a crucial area of study in ophthalmology for years. However, the significant discrepancy between fundus image datasets, each generated using a single type of fundus camera, poses challenges to the generalizability of ONH detection approaches developed based on semantic segmentation networks. Despite the numerous recent advancements in general-purpose semantic segmentation methods using convolutional neural networks (CNNs) and Transformers, there is currently a lack of benchmarks for these state-of-the-art (SoTA) networks specifically trained for ONH detection. Therefore, in this article, we make contributions from three key aspects: network design, the publication of a dataset, and the establishment of a comprehensive benchmark. Our newly developed ONH detection network, referred to as ODFormer, is based upon the Swin Transformer architecture and incorporates two novel components: a multi-scale context aggregator and a lightweight bidirectional feature recalibrator. Our published large-scale dataset, known as TongjiU-DROD, provides multi-resolution fundus images for each participant, captured using two distinct types of cameras. Our established benchmark involves three datasets: DRIONS-DB, DRISHTI-GS1, and TongjiU-DROD, created by researchers from different countries and containing fundus images captured from participants of diverse races and ages. Extensive experimental results demonstrate that our proposed ODFormer outperforms other state-of-the-art (SoTA) networks in terms of performance and generalizability. Our dataset and source code are publicly available at mias.group/ODFormer.

Symmetry-breaking plays a pivotal role in unlocking intriguing properties and functionalities in material systems. For example, the breaking of spatial and temporal symmetries leads to a fascinating phenomenon of superconducting diode effect. However, generating and precisely controlling the superconducting diode effect poses significant challenges. Here, we take a novel route with deliberate manipulation of magnetic charge potentials to realize unconventional superconducting flux-quantum diode effects. We achieve this through suitably tailored nanoengineered arrays of nanobar magnets on top of a superconducting thin film. We demonstrate the vital roles of inversion antisymmetry and its breaking in evoking unconventional superconducting effects-a magnetically symmetric diode effect and an odd-parity magnetotransport effect. These effects are non-volatilely controllable through in-situ magnetization switching of the nanobar magnets. Our findings promote the use of antisymmetry (breaking) for initiating unconventional superconducting properties, paving the way for exciting prospects and innovative functionalities in superconducting electronics.

Diabetic retinopathy (DR), as a debilitating ocular complication, necessitates prompt intervention and treatment. Despite the effectiveness of artificial intelligence in aiding DR grading, the progression of research toward enhancing the interpretability of DR grading through precise lesion segmentation faces a severe hindrance due to the scarcity of pixel-level annotated DR datasets. To mitigate this, this paper presents and delineates TJDR, a high-quality DR pixel-level annotation dataset, which comprises 561 color fundus images sourced from the Tongji Hospital Affiliated to Tongji University. These images are captured using diverse fundus cameras including Topcon's TRC-50DX and Zeiss CLARUS 500, exhibit high resolution. For the sake of adhering strictly to principles of data privacy, the private information of images is meticulously removed while ensuring clarity in displaying anatomical structures such as the optic disc, retinal blood vessels, and macular fovea. The DR lesions are annotated using the Labelme tool, encompassing four prevalent DR lesions: Hard Exudates (EX), Hemorrhages (HE), Microaneurysms (MA), and Soft Exudates (SE), labeled respectively from 1 to 4, with 0 representing the background. Significantly, experienced ophthalmologists conduct the annotation work with rigorous quality assurance, culminating in the construction of this dataset. This dataset has been partitioned into training and testing sets and publicly released to contribute to advancements in the DR lesion segmentation research community.

Many real-world processes have complex tail dependence structures that cannot be characterized using classical Gaussian processes. More flexible spatial extremes models exhibit appealing extremal dependence properties but are often exceedingly prohibitive to fit and simulate from in high dimensions. In this paper, we aim to push the boundaries on computation and modeling of high-dimensional spatial extremes via integrating a new spatial extremes model that has flexible and non-stationary dependence properties in the encoding-decoding structure of a variational autoencoder called the XVAE. The XVAE can emulate spatial observations and produce outputs that have the same statistical properties as the inputs, especially in the tail. Our approach also provides a novel way of making fast inference with complex extreme-value processes. Through extensive simulation studies, we show that our XVAE is substantially more time-efficient than traditional Bayesian inference while outperforming many spatial extremes models with a stationary dependence structure. Lastly, we analyze a high-resolution satellite-derived dataset of sea surface temperature in the Red Sea, which includes 30 years of daily measurements at 16703 grid cells. We demonstrate how to use XVAE to identify regions susceptible to marine heatwaves under climate change and examine the spatial and temporal variability of the extremal dependence structure., Comment: 30 pages, 8 figures

It is known that autonomous cars can increase road capacities by maintaining a smaller headway through vehicle platooning. Recent works have shown that these capacity increases can influence vehicles' route choices in unexpected ways similar to the well-known Braess's paradox, such that the network congestion might increase. In this paper, we propose that in mixed-autonomy networks, i.e., networks where roads are shared between human-driven and autonomous cars, the headway of autonomous cars can be directly controlled to influence vehicles' routing and reduce congestion. We argue that the headway of autonomous cars -- and consequently the capacity of link segments -- is not just a fixed design choice; but rather, it can be leveraged as an {infrastructure control} strategy to {dynamically} regulate capacities. Imagine that similar to variable speed limits which regulate the maximum speed of vehicles on a road segment, a control policy regulates the headway of autonomous cars along each road segment. We seek to influence vehicles' route choices by directly controlling the headway of autonomous cars to prevent Braess-like unexpected outcomes and increase network efficiency. We model the dynamics of mixed-autonomy traffic networks while accounting for the vehicles' route choice dynamics. We train an RL policy that learns to regulate the headway of autonomous cars such that the total travel time in the network is minimized. We will show empirically that our trained policy can not only prevent Braess-like inefficiencies but also decrease total travel time., Comment: 7 pages, 7 figures, The 40th IEEE Conference on Robotics and Automation (ICRA 2023)

We propose a decoding-based approach to detect context effects on neural codes in longitudinal neural recording data. The approach is agnostic to how information is encoded in neural activity, and can control for a variety of possible confounding factors present in the data. We demonstrate our approach by determining whether it is possible to decode location encoding from prefrontal cortex in the mouse and, further, testing whether the encoding changes due to task engagement., Comment: 39 pages, 13 figures

In multivariate regression, when covariates are numerous, it is often reasonable to assume that only a small number of them has predictive information. In some medical applications for instance, it is believed that only a few genes out of thousands are responsible for cancers. In that case, the aim is not only to propose a good fit, but also to select the relevant covariates (genes). We propose to perform model selection with additive models in high dimensions (sample size and number of covariates). Our approach is computationally efficient thanks to fast wavelet transforms, it does not rely on cross validation, and it solves a convex optimization problem for a prescribed penalty parameter, called the quantile universal threshold. We also propose a second rule based on Stein unbiased risk estimation geared towards prediction. We use Monte Carlo simulations and real data to compare various methods based on false discovery rate (FDR), true positive rate (TPR) and mean squared error. Our approach is the only one to handle high dimensions, and has the best FDR--TPR trade-off., Comment: 28 pages, 3 figures and 2 tables

This paper aims to design a distributed coordination algorithm for solving a multi-agent decision problem with a hierarchical structure. The primary goal is to search the Nash equilibrium of a noncooperative game such that each player has no incentive to deviate from the equilibrium under its private objective. Meanwhile, the agents can coordinate to optimize the social cost within the set of Nash equilibria of the underlying game. Such an optimal Nash equilibrium problem can be modeled as a distributed optimization problem with variational inequality constraints. We consider the scenario where the objective functions of both the underlying game and social cost optimization problem have a special aggregation structure. Since each player only has access to its local objectives while cannot know all players' decisions, a distributed algorithm is highly desirable. By utilizing the Tikhonov regularization and dynamical averaging tracking technique, we propose a distributed coordination algorithm by introducing an incentive term in addition to the gradient-based Nash equilibrium seeking, so as to intervene players' decisions to improve the system efficiency. We prove its convergence to the optimal Nash equilibrium of a monotone aggregative game with simulation studies., Comment: 7 pages, 3 figures

The metric-adjusted skew information establishes a connection between the geometrical formulation of quantum statistics and the measures of quantum information. We study uncertainty relations in product and summation forms of metric-adjusted skew information. We present lower bounds on product and summation uncertainty inequalities based on metric-adjusted skew information via operator representation of observables. Explicit examples are provided to back our claims., Comment: 11 pages, 2 figures

The uncertainty principle is one of the fundamental features of quantum mechanics and plays a vital role in quantum information processing. We study uncertainty relations based on metric-adjusted skew information for finite quantum observables. Motivated by the paper [Physical Review A 104, 052414 (2021)], we establish tighter uncertainty relations in terms of different norm inequalities. Naturally, we generalize the method to uncertainty relations of metric-adjusted skew information for quantum channels and unitary operators. As both the Wigner-Yanase-Dyson skew information and the quantum Fisher information are the special cases of the metric-adjusted skew information corresponding to different Morozova-Chentsov functions, our results generalize some existing uncertainty relations. Detailed examples are given to illustrate the advantages of our methods., Comment: 14 pages, 3 figures

To fit sparse linear associations, a LASSO sparsity inducing penalty with a single hyperparameter provably allows to recover the important features (needles) with high probability in certain regimes even if the sample size is smaller than the dimension of the input vector (haystack). More recently learners known as artificial neural networks (ANN) have shown great successes in many machine learning tasks, in particular fitting nonlinear associations. Small learning rate, stochastic gradient descent algorithm and large training set help to cope with the explosion in the number of parameters present in deep neural networks. Yet few ANN learners have been developed and studied to find needles in nonlinear haystacks. Driven by a single hyperparameter, our ANN learner, like for sparse linear associations, exhibits a phase transition in the probability of retrieving the needles, which we do not observe with other ANN learners. To select our penalty parameter, we generalize the universal threshold of Donoho and Johnstone (1994) which is a better rule than the conservative (too many false detections) and expensive cross-validation. In the spirit of simulated annealing, we propose a warm-start sparsity inducing algorithm to solve the high-dimensional, non-convex and non-differentiable optimization problem. We perform precise Monte Carlo simulations to show the effectiveness of our approach.

Emerging edge computing platforms often contain machine learning (ML) accelerators that can accelerate inference for a wide range of neural network (NN) models. These models are designed to fit within the limited area and energy constraints of the edge computing platforms, each targeting various applications (e.g., face detection, speech recognition, translation, image captioning, video analytics). To understand how edge ML accelerators perform, we characterize the performance of a commercial Google Edge TPU, using 24 Google edge NN models (which span a wide range of NN model types) and analyzing each NN layer within each model. We find that the Edge TPU suffers from three major shortcomings: (1) it operates significantly below peak computational throughput, (2) it operates significantly below its theoretical energy efficiency, and (3) its memory system is a large energy and performance bottleneck. Our characterization reveals that the one-size-fits-all, monolithic design of the Edge TPU ignores the high degree of heterogeneity both across different NN models and across different NN layers within the same NN model, leading to the shortcomings we observe. We propose a new acceleration framework called Mensa. Mensa incorporates multiple heterogeneous edge ML accelerators (including both on-chip and near-data accelerators), each of which caters to the characteristics of a particular subset of NN models and layers. During NN inference, for each NN layer, Mensa decides which accelerator to schedule the layer on, taking into account both the optimality of each accelerator for the layer and layer-to-layer communication costs. Averaged across all 24 Google edge NN models, Mensa improves energy efficiency and throughput by 3.0x and 3.1x over the Edge TPU, and by 2.4x and 4.3x over Eyeriss~v2, a state-of-the-art accelerator., Comment: This work appears at the 30th International Conference on Parallel Architectures and Compilation Techniques (PACT 2021). arXiv admin note: substantial text overlap with arXiv:2103.00768

As the need for edge computing grows, many modern consumer devices now contain edge machine learning (ML) accelerators that can compute a wide range of neural network (NN) models while still fitting within tight resource constraints. We analyze a commercial Edge TPU using 24 Google edge NN models (including CNNs, LSTMs, transducers, and RCNNs), and find that the accelerator suffers from three shortcomings, in terms of computational throughput, energy efficiency, and memory access handling. We comprehensively study the characteristics of each NN layer in all of the Google edge models, and find that these shortcomings arise from the one-size-fits-all approach of the accelerator, as there is a high amount of heterogeneity in key layer characteristics both across different models and across different layers in the same model. We propose a new acceleration framework called Mensa. Mensa incorporates multiple heterogeneous ML edge accelerators (including both on-chip and near-data accelerators), each of which caters to the characteristics of a particular subset of models. At runtime, Mensa schedules each layer to run on the best-suited accelerator, accounting for both efficiency and inter-layer dependencies. As we analyze the Google edge NN models, we discover that all of the layers naturally group into a small number of clusters, which allows us to design an efficient implementation of Mensa for these models with only three specialized accelerators. Averaged across all 24 Google edge models, Mensa improves energy efficiency and throughput by 3.0x and 3.1x over the Edge TPU, and by 2.4x and 4.3x over Eyeriss v2, a state-of-the-art accelerator.

In the research field of big data, one of important issues is how to recover the sequentially changing sets of true features when the data sets arrive sequentially. The paper presents a general framework for online updating variable selection and parameter estimation in generalized linear models with streaming datasets. This is a type of online updating penalty likelihoods with differentiable or non-differentiable penalty function. The online updating coordinate descent algorithm is proposed to solve the online updating optimization problem. Moreover, a tuning parameter selection is suggested in an online updating way. The selection and estimation consistencies, and the oracle property are established, theoretically. Our methods are further examined and illustrated by various numerical examples from both simulation experiments and a real data analysis., Comment: 35 pages, 2 figures, 13 tables

The ability to control the potential landscape in a medium of interacting particles could lead to intriguing collective behavior and innovative functionalities. Here, we utilize spatially reconfigurable magnetic potentials of a pinwheel artificial spin ice structure to tailor the motion of superconducting vortices. The reconstituted chain structures of the magnetic charges in the artificial pinwheel spin ice and the strong interaction between magnetic charges and superconducting vortices allow significant modification of the transport properties of the underlying superconducting thin film, resulting in a reprogrammable resistance state that enables a reversible and switchable vortex Hall effect. Our results highlight an effective and simple method of using artificial spin ice as an in-situ reconfigurable nanoscale energy landscape to design reprogrammable superconducting electronics, which could also be applied to the in-situ control of properties and functionalities in other magnetic particle systems, such as magnetic skyrmions., Comment: To appear in Nano Letters

We present a nanoparticle size-separation device based on a nanofluidic rocking Brownian motor. It features a ratchet-shaped electrostatic particle potential with increasing barrier heights along the particle transport direction. The sharp drop of the particle current with barrier height is exploited to separate a particle suspension into multiple sub-populations. By solving the Fokker--Planck equation, we show that the physics of the separation mechanism is governed by the energy landscape under forward tilt of the ratchet. For a given device geometry and sorting duration, the applied force is thus the only tunable parameter to increase the separation resolution. For the experimental conditions of 3.5 V applied voltage and 20 s sorting, we predict a separation resolution of $\sim 2$ nm, supported by experimental data for separating spherical gold particles of nominal 80 and 100 nm diameters., Comment: 5 pages, 4 figures plus supplemental material

Colloidal quantum dots (QDs) of group III-V are considered as promising candidates for next-generation environmentally friendly light emitting devices, yet there appears to be only limited understanding of the underlying electronic and excitonic properties. Using large-scale density functional theory with the hybrid B3LYP functional solving the single-particle states and time-dependent density functional theory accounting for the many-body excitonic effects, we have identified the structural, electronic and excitonic optical properties of InP, GaP and GaInP QDs containing up to a thousand atoms or more. The calculated optical gap of InP QD appears in excellent agreement with available experiments, and it scales nearly linearly with the inverse diameter. The radiative exciton decay lifetime is found to increase surprisingly linearly with increasing the dot size. For GaP QDs, we predict an unusual electronic state crossover at diameter around 1.5 nm whereby the nature of the lowest unoccupied molecular orbital (LUMO) state switches its symmetry from $\Gamma_{5}$-like at larger diameter to $\Gamma_{1}$-like at smaller diameter. After the crossover, the absorption intensity of the band-edge exciton states is significantly enhanced. Finally, we find that Vegard's law holds very well for GaInP random alloyed quantum dots down to ultra-small sizes with less than a hundred atoms. The obtained energy gap bowing parameter of this common-cation compound in QD regime appears positive, size-dependent and much smaller than its bulk parentage. The volume deformation, dominating over the charge exchange and structure relaxation effects, is mainly responsible for the QD energy gap bowing. The present work provides a road map for a variety of electronic and optical properties of colloidal QDs in group III-V that can guide spectroscopic studies., Comment: 10 pages, 6 figures

Geometric frustration emerges when local interaction energies in an ordered lattice structure cannot be simultaneously minimized, resulting in a large number of degenerate states. The numerous degenerate configurations may lead to practical applications in microelectronics, such as data storage, memory and logic. However, it is difficult to achieve extensive degeneracy, especially in a two-dimensional system. Here, we showcase in-situ controllable geometric frustration with massive degeneracy in a two-dimensional flux quantum system. We create this in a superconducting thin film placed underneath a reconfigurable artificial-spin-ice structure. The tunable magnetic charges in the artificial-spin-ice strongly interact with the flux quanta in the superconductor, enabling the switching between frustrated and crystallized flux quanta states. The different states have measurable effects on the superconducting critical current profile, which can be reconfigured by precise selection of the spin ice magnetic state through application of an external magnetic field. We demonstrate the applicability of these effects by realizing a reprogrammable flux quanta diode. The tailoring of the energy landscape of interacting 'particles' using artificial-spin-ices provides a new paradigm for the design of geometric frustration, which allows us to control new functionalities in other material systems, such as magnetic skyrmions, electrons/holes in two-dimensional materials and topological insulators, as well as colloids in soft materials., Comment: 32 pages, 14 figures