Search

How can we test AI performance? This question seems trivial, but it isn't. Standard benchmarks often have problems such as in-distribution and small-size test sets, oversimplified metrics, unfair comparisons, and short-term outcome pressure. As a consequence, good performance on standard benchmarks does not guarantee success in real-world scenarios. To address these problems, we present Touchstone, a large-scale collaborative segmentation benchmark of 9 types of abdominal organs. This benchmark is based on 5,195 training CT scans from 76 hospitals around the world and 5,903 testing CT scans from 11 additional hospitals. This diverse test set enhances the statistical significance of benchmark results and rigorously evaluates AI algorithms across various out-of-distribution scenarios. We invited 14 inventors of 19 AI algorithms to train their algorithms, while our team, as a third party, independently evaluated these algorithms on three test sets. In addition, we also evaluated pre-existing AI frameworks--which, differing from algorithms, are more flexible and can support different algorithms--including MONAI from NVIDIA, nnU-Net from DKFZ, and numerous other open-source frameworks. We are committed to expanding this benchmark to encourage more innovation of AI algorithms for the medical domain., Comment: Accepted to NeurIPS-2024

Young star-forming regions in massive environments are ideal test beds to study the influence of surroundings on the evolution of disks around low-mass stars. We explore two distant young clusters, IC 1848-East and West located in the massive W5 complex. These clusters are unique due to their similar (distance, age, and extinction) yet distinct (stellar density and FUV radiation fields) physical properties. We use deep multi-band photometry in optical, near-IR, and mid-IR wavelengths complete down to the substellar limit in at least five bands. We trace the spectral energy distribution of the sources to identify the young pre-main sequence members in the region and derive their physical parameters. The disk fraction for the East and West clusters down to 0.1 M$_\odot$ was found to be $\sim$27$\pm$2% (N$_{disk}$=184, N$_{diskless}$=492) and $\sim$17$\pm$1% (N$_{disk}$=173, N$_{diskless}$=814), respectively. While no spatial variation in the disk fraction is observed, these values are lower than those in other nearby young clusters. Investigating the cause of this decrease, we find a correlation with the intense feedback from massive stars throughout the cluster area. We also identified the disk sources undergoing accretion and observed the mass accretion rates to exhibit a positive linear relationship with the stellar host mass and an inverse relationship with stellar age. Our findings suggest that the environment significantly influences the dissipation of disks in both clusters. These distant clusters, characterized by their unique attributes, can serve as templates for future studies in outer galaxy regions, offering insights into the influence of feedback mechanisms on star and planetary formation., Comment: Accepted for publication in Monthly Notices of the Royal Astronomical Society (MNRAS). 18 pages, 11 figures, 1 table

Diffusion models excel at creating visually impressive images but often struggle to generate images with a specified topology. The Betti number, which represents the number of structures in an image, is a fundamental measure in topology. Yet, diffusion models fail to satisfy even this basic constraint. This limitation restricts their utility in applications requiring exact control, like robotics and environmental modeling. To address this, we propose TopoDiffusionNet (TDN), a novel approach that enforces diffusion models to maintain the desired topology. We leverage tools from topological data analysis, particularly persistent homology, to extract the topological structures within an image. We then design a topology-based objective function to guide the denoising process, preserving intended structures while suppressing noisy ones. Our experiments across four datasets demonstrate significant improvements in topological accuracy. TDN is the first to integrate topology with diffusion models, opening new avenues of research in this area., Comment: 20 pages, 11 figures, 7 tables

The emergence of Vision-Language Models (VLMs) represents a significant advancement in integrating computer vision with Large Language Models (LLMs) to generate detailed text descriptions from visual inputs. Despite their growing importance, the security of VLMs, particularly against backdoor attacks, is under explored. Moreover, prior works often assume attackers have access to the original training data, which is often unrealistic. In this paper, we address a more practical and challenging scenario where attackers must rely solely on Out-Of-Distribution (OOD) data. We introduce VLOOD (Backdooring Vision-Language Models with Out-of-Distribution Data), a novel approach with two key contributions: (1) demonstrating backdoor attacks on VLMs in complex image-to-text tasks while minimizing degradation of the original semantics under poisoned inputs, and (2) proposing innovative techniques for backdoor injection without requiring any access to the original training data. Our evaluation on image captioning and visual question answering (VQA) tasks confirms the effectiveness of VLOOD, revealing a critical security vulnerability in VLMs and laying the foundation for future research on securing multimodal models against sophisticated threats.

Spintronic-based neuromorphic hardware offers high-density and rapid data processing at nanoscale lengths by leveraging magnetic configurations like skyrmion and domain walls. Here, we present the maximal hardware implementation of a convolutional neural network (CNN) based on a compact multi-bit skyrmion-based synapse and a hybrid CMOS domain wall-based circuit for activation and max-pooling functionalities. We demonstrate the micromagnetic design and operation of a circular bilayer skyrmion system mimicking a scalable artificial synapse, demonstrated up to 6-bit (64 states) with an ultra-low energy consumption of 0.87 fJ per state update. We further show that the synaptic weight modulation is achieved by the perpendicular current interaction with the labyrinth-maze like uniaxial anisotropy profile, inducing skyrmionic gyration, thereby enabling long-term potentiation (LTP) and long-term depression (LTD) operations. Furthermore, we present a simultaneous rectified linear (ReLU) activation and max pooling circuitry featuring a SOT-based domain wall ReLU with a power consumption of 4.73 $\mu$W. The ReLU function, stabilized by a parabolic uniaxial anisotropy profile, encodes domain wall positions into continuous resistance states coupled with the HSPICE circuit simulator. Our integrated skyrmion and domain wall-based spintronic hardware achieves 98.07% accuracy in convolutional neural network (CNN) based pattern recognition task, consuming 110 mW per image., Comment: 15 pages, 10 figures

Spintronic nano-oscillators can generate tunable microwave signals that find a wide range of applications in the field of telecommunication to modern neuromorphic computing systems. Among other spintronic devices, a magnetic skyrmion is a promising candidate for the next generation of low-power devices due to its small size and topological stability. In this work, we propose a multi-channel oscillator design based on the synthetic anti-ferromagnetic (SAF) skyrmion pair. The mitigation of the skyrmion Hall effect in SAF and the associated decimation of the Magnus force endows the proposed oscillator with an ultra-high frequency of 41GHz and a multi-channel frequency output driven by the same current. The ultrahigh operational frequency represents an $\sim$342 times improvement compared to the monolayer single skyrmion oscillator featuring a constant uniaxial anisotropy profile. Using micromagnetic simulations, we demonstrate the effectiveness of our proposed multi-channel oscillator design by introducing multi-channel nanotracks along with multiple skyrmions for enhanced frequency operation. The ultrahigh operational frequency and multi-channel output are attributed to three key factors: The oscillator design accounting for a finite spin-flip length of the spacer (such as Ru) material, tangential velocity proportionality on input spin current along with weak dependence on the radius of rotation of the skyrmion-pair, skyrmion interlocking in the channel enabled by the multi-channel high Ku rings and skyrmion-skyrmion repulsion, therefore resulting ultrahigh frequency and multi-channel outputs.

Young stellar clusters are predominantly the hub of star formation and hence, ideal to perform comprehensive studies over the least explored sub-stellar regime. Various unanswered questions like the mass distribution in brown dwarf regime and the effect of diverse cluster environment on brown dwarf formation efficiency still plague the scientific community. The nearby young cluster, IC 1396 with its feedback-driven environment, is ideal to conduct such study. In this paper we adopt a multi-wavelength approach, using deep Subaru HSC, Gaia DR3, Pan-STARRS, UKIDSS/2MASS photometry and machine learning techniques to identify the cluster members complete down to $\sim$ 0.03 M$_{\odot}$ in the central 22$^{\prime}$ area of IC 1396. We identify 458 cluster members including 62 brown dwarfs which are used to determine mass distribution in the region. We obtain a star-to-brown dwarf ratio of $\sim$ 6 for a stellar mass range 0.03 -- 1 M$_{\odot}$ in the studied cluster. The brown dwarf fraction is observed to increase across the cluster as radial distance from the central OB-stars increases. This study also compiles 15 young stellar clusters to check the variation of star-to-brown dwarf ratio relative to stellar density and UV flux ranging within 4-2500 stars pc$^{-2}$ and 0.7-7.3 G$_{0}$ respectively. The brown dwarf fraction is observed to increase with stellar density but the results about the influence of incident UV flux are inconclusive within this range. This is the deepest study of IC 1396 as of yet and it will pave the way to understand various aspects of brown dwarfs using spectroscopic observations in future., Comment: 17 pages, 24 figures, 4 tables

In digital pathology, segmenting densely distributed objects like glands and nuclei is crucial for downstream analysis. Since detailed pixel-wise annotations are very time-consuming, we need semi-supervised segmentation methods that can learn from unlabeled images. Existing semi-supervised methods are often prone to topological errors, e.g., missing or incorrectly merged/separated glands or nuclei. To address this issue, we propose TopoSemiSeg, the first semi-supervised method that learns the topological representation from unlabeled histopathology images. The major challenge is for unlabeled images; we only have predictions carrying noisy topology. To this end, we introduce a noise-aware topological consistency loss to align the representations of a teacher and a student model. By decomposing the topology of the prediction into signal topology and noisy topology, we ensure that the models learn the true topological signals and become robust to noise. Extensive experiments on public histopathology image datasets show the superiority of our method, especially on topology-aware evaluation metrics. Code is available at https://github.com/Melon-Xu/TopoSemiSeg., Comment: 28 pages, 8 figures. Accepted by ECCV 2024

Segmentation of curvilinear structures such as vasculature and road networks is challenging due to relatively weak signals and complex geometry/topology. To facilitate and accelerate large scale annotation, one has to adopt semi-automatic approaches such as proofreading by experts. In this work, we focus on uncertainty estimation for such tasks, so that highly uncertain, and thus error-prone structures can be identified for human annotators to verify. Unlike most existing works, which provide pixel-wise uncertainty maps, we stipulate it is crucial to estimate uncertainty in the units of topological structures, e.g., small pieces of connections and branches. To achieve this, we leverage tools from topological data analysis, specifically discrete Morse theory (DMT), to first capture the structures, and then reason about their uncertainties. To model the uncertainty, we (1) propose a joint prediction model that estimates the uncertainty of a structure while taking the neighboring structures into consideration (inter-structural uncertainty); (2) propose a novel Probabilistic DMT to model the inherent uncertainty within each structure (intra-structural uncertainty) by sampling its representations via a perturb-and-walk scheme. On various 2D and 3D datasets, our method produces better structure-wise uncertainty maps compared to existing works. Code available at https://github.com/Saumya-Gupta-26/struct-uncertainty, Comment: Accepted to NeurIPS 2023; 22 pages, 14 figures, 6 tables

Identifying and characterizing young populations of star-forming regions is crucial to unravel their properties. In this regard, Gaia-DR3 data and machine learning tools are very useful for studying large star-forming complexes. In this work, we analyze the $\rm \sim7.1degree^2$ area of one of our Galaxy's dominant feedback-driven star-forming complexes, i.e., the region around Trumpler 37. Using the Gaussian mixture and random forest classifier methods, we identify 1243 high-probable members in the complex, of which $\sim60\%$ are new members and are complete down to the mass limit of $\sim$0.1 $-$ 0.2~$\rm M_{\odot}$. The spatial distribution of the stars reveals multiple clusters towards the complex, where the central cluster around the massive star HD 206267 reveals two sub-clusters. Of the 1243 stars, 152 have radial velocity, with a mean value of $\rm -16.41\pm0.72~km/s$. We investigate stars' internal and relative movement within the central cluster. The kinematic analysis shows that the cluster's expansion is relatively slow compared to the whole complex. This slow expansion is possibly due to newly formed young stars within the cluster. We discuss these results in the context of hierarchical collapse and feedback-induced collapse mode of star formation in the complex., Comment: 23 pages, 15 figures, accepted for publication in ApJ

Deep learning methods have achieved impressive performance for multi-class medical image segmentation. However, they are limited in their ability to encode topological interactions among different classes (e.g., containment and exclusion). These constraints naturally arise in biomedical images and can be crucial in improving segmentation quality. In this paper, we introduce a novel topological interaction module to encode the topological interactions into a deep neural network. The implementation is completely convolution-based and thus can be very efficient. This empowers us to incorporate the constraints into end-to-end training and enrich the feature representation of neural networks. The efficacy of the proposed method is validated on different types of interactions. We also demonstrate the generalizability of the method on both proprietary and public challenge datasets, in both 2D and 3D settings, as well as across different modalities such as CT and Ultrasound. Code is available at: https://github.com/TopoXLab/TopoInteraction, Comment: Accepted to ECCV 2022 (Oral); 32 pages, 19 figures

Low mass star formation inside massive clusters is crucial to understand the effect of cluster environment on processes like circumstellar disk evolution, planet and brown dwarf formation. The young massive association of Cygnus OB2, with a strong feedback from massive stars, is an ideal target to study the effect of extreme environmental conditions on its extensive low-mass population. We aim to perform deep multi-wavelength studies to understand the role of stellar feedback on the IMF, brown dwarf fraction and circumstellar disk properties in the region. We introduce here, the deepest and widest optical photometry of 1.5$^\circ$ diameter region centred at Cygnus OB2 in r$_{2}$, i$_{2}$, z and Y-filters using Subaru Hyper Suprime-Cam (HSC). This work presents the data reduction, source catalog generation, data quality checks and preliminary results about the pre-main sequence sources. We obtain 713,529 sources in total, with detection down to $\sim$ 28 mag, 27 mag, 25.5 mag and 24.5 mag in r$_{2}$, i$_{2}$, z and Y-band respectively, which is $\sim$ 3 - 5 mag deeper than the existing Pan-STARRS and GTC/OSIRIS photometry. We confirm the presence of a distinct pre-main sequence branch by statistical field subtraction of the central 18$^\prime$ region. We find the median age of the region as $\sim$ 5 $\pm$ 2 Myrs with an average disk fraction of $\sim$ 9$\%$. At this age, combined with A$_V$ $\sim$ 6 - 8 mag, we detect sources down to a mass range $\sim$ 0.01 - 0.17 M$_\odot$. The deep HSC catalog will serve as the groundwork for further studies on this prominent active young cluster., Comment: Accepted for publication in Monthly Notices of Royal Astronomical Society (MNRAS), 20 pages, 21 figures, 4 Tables, typos corrected

The quality of images captured by smartphones is an important specification since smartphones are becoming ubiquitous as primary capturing devices. The traditional image signal processing (ISP) pipeline in a smartphone camera consists of several image processing steps performed sequentially to reconstruct a high quality sRGB image from the raw sensor data. These steps consist of demosaicing, denoising, white balancing, gamma correction, colour enhancement, etc. Since each of them are performed sequentially using hand-crafted algorithms, the residual error from each processing module accumulates in the final reconstructed signal. Thus, the traditional ISP pipeline has limited reconstruction quality in terms of generalizability across different lighting conditions and associated noise levels while capturing the image. Deep learning methods using convolutional neural networks (CNN) have become popular in solving many image-related tasks such as image denoising, contrast enhancement, super resolution, deblurring, etc. Furthermore, recent approaches for the RAW to sRGB conversion using deep learning methods have also been published, however, their immense complexity in terms of their memory requirement and number of Mult-Adds make them unsuitable for mobile camera ISP. In this paper we propose DelNet - a single end-to-end deep learning model - to learn the entire ISP pipeline within reasonable complexity for smartphone deployment. Del-Net is a multi-scale architecture that uses spatial and channel attention to capture global features like colour, as well as a series of lightweight modified residual attention blocks to help with denoising. For validation, we provide results to show the proposed Del-Net achieves compelling reconstruction quality.

DNA copy number aberrations (CNAs) can be found in the majority of cancer genomes, and are crucial for understanding the potential mechanisms underlying tumor initiation and progression. Since the first release in 2001, the Progenetix project (http://www.progenetix.org) has provided a reference resource dedicated to provide the most comprehensive collection of genome-wide CNA profiles. Reflecting the application of comparative genomic hybridization (CGH) techniques to tens of thousands of cancer genomes, over the past 12 years our data curation efforts have resulted in a more than 60-fold increase in the number of cancer samples presented through Progenetix. In addition, new data exploration tools and visualization options have been added. In particular, the gene specific CNA frequency analysis should facilitate the assignment of cancer genes to related cancer types. Additionally, the new user file processing interface allows users to take advantage of the online tools, including various data representation options for proprietary data pre-publication. In this update article, we report recent improvements of the database in terms of content, user interface and online tools., Comment: Accepted at Nucleic Acid Research (NAR 2014 database issue)