Search

Scene text detection is a challenging computer vision task due to the high variation in text shapes and ratios. In this work, we propose a scene text detector named Deformable Kernel Expansion (DKE), which incorporates the merits of both segmentation and contour-based detectors. DKE employs a segmentation module to segment the shrunken text region as the text kernel, then expands the text kernel contour to obtain text boundary by regressing the vertex-wise offsets. Generating the text kernel by segmentation enables DKE to inherit the arbitrary-shaped text region modeling capability of segmentation-based detectors. Regressing the kernel contour with some sampled vertices enables DKE to avoid the complicated pixel-level post-processing and better learn contour deformation as the contour-based detectors. Moreover, we propose an Optimal Bipartite Graph Matching Loss (OBGML) that measures the matching error between the predicted contour and the ground truth, which efficiently minimizes the global contour matching distance. Extensive experiments on CTW1500, Total-Text, MSRA-TD500, and ICDAR2015 demonstrate that DKE achieves a good tradeoff between accuracy and efficiency in scene text detection.

Physics-informed neural networks (PINNs) have effectively been demonstrated in solving forward and inverse differential equation problems, but they are still trapped in training failures when the target functions to be approximated exhibit high-frequency or multi-scale features. In this paper, we propose to employ implicit stochastic gradient descent (ISGD) method to train PINNs for improving the stability of training process. We heuristically analyze how ISGD overcome stiffness in the gradient flow dynamics of PINNs, especially for problems with multi-scale solutions. We theoretically prove that for two-layer fully connected neural networks with large hidden nodes, randomly initialized ISGD converges to a globally optimal solution for the quadratic loss function. Empirical results demonstrate that ISGD works well in practice and compares favorably to other gradient-based optimization methods such as SGD and Adam, while can also effectively address the numerical stiffness in training dynamics via gradient descent., Comment: 17 pages, published as a conference paper at AAAI23

The spatial variation and temporal variation in surface potential are important error sources in various precision experiments and deserved to be considered carefully. In the former case, the theoretical analysis shows that this effect depends on the surface potentials through their spatial autocorrelation functions. By making some modification to the quasi-local correlation model, we obtain a rigorous formula for the patch force, where the magnitude is proportional to ${\frac{1}{{{a}^{2}}}{{(\frac{a}{w})}^{\beta (a/w)+2}}}$ with ${a}$ the distance between two parallel plates, ${w}$ the mean patch size, and ${\beta}$ the scaling coefficient from ${-2}$ to ${-4}$. A torsion balance experiment is then conducted, and obtain a 0.4 mm effective patch size and 20 mV potential variance. In the latter case, we apply an adatom diffusion model to describe this mechanism and predicts a ${f^{-3/4}}$ frequency dependence above 0.01 ${\rm mHz}$. This prediction meets well with a typical experimental results. Finally, we apply these models to analyze the patch effect for two typical experiments. Our analysis will help to investigate the properties of surface potentials.

One key challenge in the field of topological superconductivity (Tsc) has been the rareness of material realization. This is true not only for the first-order Tsc featuring Majorana surface modes, but also for the higher-order Tsc, which host Majorana hinge and corner modes. Here, we propose a four-step strategy that mathematically derives comprehensive guiding principles for the search and design for materials of general higher-order Tsc phases. Specifically, such recipes consist of conditions on the normal state and pairing symmetry that can lead to a given higher-order Tsc state. We demonstrate this strategy by obtaining recipes for achieving three-dimensional higher-order Tsc phases protected by the inversion symmetry. Following our recipe, we predict that the observed superconductivity in centrosymmetric MoTe$_2$ is a candidate for higher-order Tsc with corner modes. Our proposed strategy enables systematic materials search and design for higher-order Tsc, which can mobilize the experimental efforts and accelerate the material discovery for higher-order Tsc phases., Comment: 5+4 pages, 3+2 figures

Recent aerial object detection models rely on a large amount of labeled training data, which requires unaffordable manual labeling costs in large aerial scenes with dense objects. Active learning effectively reduces the data labeling cost by selectively querying the informative and representative unlabelled samples. However, existing active learning methods are mainly with class-balanced settings and image-based querying for generic object detection tasks, which are less applicable to aerial object detection scenarios due to the long-tailed class distribution and dense small objects in aerial scenes. In this paper, we propose a novel active learning method for cost-effective aerial object detection. Specifically, both object-level and image-level informativeness are considered in the object selection to refrain from redundant and myopic querying. Besides, an easy-to-use class-balancing criterion is incorporated to favor the minority objects to alleviate the long-tailed class distribution problem in model training. We further devise a training loss to mine the latent knowledge in the unlabeled image regions. Extensive experiments are conducted on the DOTA-v1.0 and DOTA-v2.0 benchmarks to validate the effectiveness of the proposed method. For the ReDet, KLD, and SASM detectors on the DOTA-v2.0 dataset, the results show that our proposed MUS-CDB method can save nearly 75\% of the labeling cost while achieving comparable performance to other active learning methods in terms of mAP.Code is publicly online (https://github.com/ZJW700/MUS-CDB)., Comment: 13 pages, 7 figures

Pavement Distress Recognition (PDR) is an important step in pavement inspection and can be powered by image-based automation to expedite the process and reduce labor costs. Pavement images are often in high-resolution with a low ratio of distressed to non-distressed areas. Advanced approaches leverage these properties via dividing images into patches and explore discriminative features in the scale space. However, these approaches usually suffer from information loss during image resizing and low efficiency due to complex learning frameworks. In this paper, we propose a novel and efficient method for PDR. A light network named the Kernel Inversed Pyramidal Resizing Network (KIPRN) is introduced for image resizing, and can be flexibly plugged into the image classification network as a pre-network to exploit resolution and scale information. In KIPRN, pyramidal convolution and kernel inversed convolution are specifically designed to mine discriminative information across different feature granularities and scales. The mined information is passed along to the resized images to yield an informative image pyramid to assist the image classification network for PDR. We applied our method to three well-known Convolutional Neural Networks (CNNs), and conducted an evaluation on a large-scale pavement image dataset named CQU-BPDD. Extensive results demonstrate that KIPRN can generally improve the pavement distress recognition of these CNN models and show that the simple combination of KIPRN and EfficientNet-B3 significantly outperforms the state-of-the-art patch-based method in both performance and efficiency., Comment: Accepted By ICONIP as Oral paper

At ambient pressure, bulk SrCoO$_{3}$ is a ferromagnetic (FM) metal in cubic perovskite structure. By contrast, magnetic properties of epitaxial SrCoO$_{3}$ thin films, especially at high tensile strain ($\varepsilon \gtrsim 3$\%), remain unclear: Previous calculations had predicted antiferromagnetic (AFM) states more energetically favorable in this regime, but recent experiments indicated a FM insulating state. In this work, using first-principles calculations, we perform an extensive search for the structural, spin, magnetic, and orbital states of SrCoO$_{3}$ thin films. Our calculations indicate that at $0 < \varepsilon \lesssim 2.5$\%, SrCoO$_{3}$ favors a FM half-metallic state with intermediate-spin ($t_{2g}^{5}e_{g}^{1}$-like) Co exhibiting $d^{6}\underline L$ character. At $\varepsilon \gtrsim 2.5$\%, a FM insulating state with high-spin ($t_{2g}^{4}e_{g}^{2}$-like) Co dominates. This FM insulating state is achieved via complicated orbital ordering, cooperative Jahn--Teller distortion, and octahedral tilting about all three crystal axes., Comment: 15 pages, 4 figures

Topological band theory predicts a $\mathbb{Z}$ classification of three-dimensional (3D) Dirac semimetals (DSMs) at the single-particle level. Namely, an arbitrary number of identical bulk Dirac nodes will always remain locally stable and gapless in the single-particle band spectrum, as long as the protecting symmetry is preserved. In this work, we find that this single-particle classification for $C_n$-symmetric DSMs will break down to $\mathbb{Z}_{n/\text{gcd}(2,n)}$ in the presence of symmetry-preserving electron interactions. Our theory is based on a dimensional reduction strategy which reduces a 3D Dirac fermions to 1D building blocks, i.e., vortex-line modes, while respecting all the key symmetries. Using bosonization technique, we find that there exists a minimal number $N=n/\text{gcd}(2,n)$ such that the collection of vortex-line modes in $N$ copies of DSMs can be symmetrically eliminated via four-fermion interactions. While this gapping mechanism does not have any free-fermion counterpart, it yields an intuitive ``electron-trion coupling" picture. By developing a topological field theory for DSMs and further checking the anomaly-free condition, we independently arrive at the same classification results. Our theory paves the way for understanding topological crystalline semimetallic phases in the strongly correlated regime., Comment: 5+7 pages, 1 table, 1 figure

We propose to achieve joint detections of frequency and direction of arrival in wideband using single sensor based on an active metasurface with programmable transmission states of pass and stop. By integrating two PIN diodes with the opposite directions into the proposed single-layer and ultrathin meta-atom, the transmission performance with 10 dB difference between the pass and stop states is realized in the bandwidth from 5.9 GHz to 8.8 GHz using field-circuit co-simulations. Accordingly, random receiving patterns are generated by controlling the programmable metasurface composed of the switchable meta-atoms. Afterwards, the frequency and direction information of sources located in the far field are detected using the modified algorithm of estimating signal parameters via rotational invariance techniques (ESPRIT) and the compressive sensing method, respectively. A sample of the programmable metasurface is fabricated and the voltage control system is built up correspondingly. To entirely verify the validity of the proposed method, we conduct three kinds of experiments with one single source, double sources with different frequencies, and double sources with the same frequency, respectively. In all cases, the source information of frequency and direction has been detected preciously in measurements in the frequency band from 6.2 GHz to 8.8 GHz.

Automatic pavement distress classification facilitates improving the efficiency of pavement maintenance and reducing the cost of labor and resources. A recently influential branch of this task divides the pavement image into patches and addresses these issues from the perspective of multi-instance learning. However, these methods neglect the correlation between patches and suffer from a low efficiency in the model optimization and inference. Meanwhile, Swin Transformer is able to address both of these issues with its unique strengths. Built upon Swin Transformer, we present a vision Transformer named \textbf{P}avement \textbf{I}mage \textbf{C}lassification \textbf{T}ransformer (\textbf{PicT}) for pavement distress classification. In order to better exploit the discriminative information of pavement images at the patch level, the \textit{Patch Labeling Teacher} is proposed to leverage a teacher model to dynamically generate pseudo labels of patches from image labels during each iteration, and guides the model to learn the discriminative features of patches. The broad classification head of Swin Transformer may dilute the discriminative features of distressed patches in the feature aggregation step due to the small distressed area ratio of the pavement image. To overcome this drawback, we present a \textit{Patch Refiner} to cluster patches into different groups and only select the highest distress-risk group to yield a slim head for the final image classification. We evaluate our method on CQU-BPDD. Extensive results show that \textbf{PicT} outperforms the second-best performed model by a large margin of $+2.4\%$ in P@R on detection task, $+3.9\%$ in $F1$ on recognition task, and 1.8x throughput, while enjoying 7x faster training speed using the same computing resources. Our codes and models have been released on \href{https://github.com/DearCaat/PicT}{https://github.com/DearCaat/PicT}., Comment: ACM Multimedia 2022 paper, 9 pages 7 figures

Deep neural networks trained with standard cross-entropy loss are more prone to memorize noisy labels, which degrades their performance. Negative learning using complementary labels is more robust when noisy labels intervene but with an extremely slow model convergence speed. In this paper, we first introduce a bidirectional learning scheme, where positive learning ensures convergence speed while negative learning robustly copes with label noise. Further, a dynamic sample reweighting strategy is proposed to globally weaken the effect of noise-labeled samples by exploiting the excellent discriminatory ability of negative learning on the sample probability distribution. In addition, we combine self-distillation to further improve the model performance. The code is available at \url{https://github.com/chenchenzong/BLDR}.

Partial label learning (PLL) is a typical weakly supervised learning framework, where each training instance is associated with a candidate label set, among which only one label is valid. To solve PLL problems, typically methods try to perform disambiguation for candidate sets by either using prior knowledge, such as structure information of training data, or refining model outputs in a self-training manner. Unfortunately, these methods often fail to obtain a favorable performance due to the lack of prior information or unreliable predictions in the early stage of model training. In this paper, we propose a novel framework for partial label learning with meta objective guided disambiguation (MoGD), which aims to recover the ground-truth label from candidate labels set by solving a meta objective on a small validation set. Specifically, to alleviate the negative impact of false positive labels, we re-weight each candidate label based on the meta loss on the validation set. Then, the classifier is trained by minimizing the weighted cross entropy loss. The proposed method can be easily implemented by using various deep networks with the ordinary SGD optimizer. Theoretically, we prove the convergence property of meta objective and derive the estimation error bounds of the proposed method. Extensive experiments on various benchmark datasets and real-world PLL datasets demonstrate that the proposed method can achieve competent performance when compared with the state-of-the-art methods., Comment: 10 pages

(3+1)D topological phases of matter can host a broad class of non-trivial topological defects of codimension-1, 2, and 3, of which the well-known point charges and flux loops are special cases. The complete algebraic structure of these defects defines a higher category, and can be viewed as an emergent higher symmetry. This plays a crucial role both in the classification of phases of matter and the possible fault-tolerant logical operations in topological quantum error correcting codes. In this paper, we study several examples of such higher codimension defects from distinct perspectives. We mainly study a class of invertible codimension-2 topological defects, which we refer to as twist strings. We provide a number of general constructions for twist strings, in terms of gauging lower dimensional invertible phases, layer constructions, and condensation defects. We study some special examples in the context of $\mathbb{Z}_2$ gauge theory with fermionic charges, in $\mathbb{Z}_2 \times \mathbb{Z}_2$ gauge theory with bosonic charges, and also in non-Abelian discrete gauge theories based on dihedral ($D_n$) and alternating ($A_6$) groups. The intersection between twist strings and Abelian flux loops sources Abelian point charges, which defines an $H^4$ cohomology class that characterizes part of an underlying 3-group symmetry of the topological order. The equations involving background gauge fields for the 3-group symmetry have been explicitly written down for various cases. We also study examples of twist strings interacting with non-Abelian flux loops (defining part of a non-invertible higher symmetry), examples of non-invertible codimension-2 defects, and examples of interplay of codimension-2 defects with codimension-1 defects. We also find an example of geometric, not fully topological, twist strings in (3+1)D $A_6$ gauge theory., Comment: 70 pages, 42 figures

In this paper, we study the partial multi-label (PML) image classification problem, where each image is annotated with a candidate label set consists of multiple relevant labels and other noisy labels. Existing PML methods typically design a disambiguation strategy to filter out noisy labels by utilizing prior knowledge with extra assumptions, which unfortunately is unavailable in many real tasks. Furthermore, because the objective function for disambiguation is usually elaborately designed on the whole training set, it can be hardly optimized in a deep model with SGD on mini-batches. In this paper, for the first time we propose a deep model for PML to enhance the representation and discrimination ability. On one hand, we propose a novel curriculum based disambiguation strategy to progressively identify ground-truth labels by incorporating the varied difficulties of different classes. On the other hand, a consistency regularization is introduced for model retraining to balance fitting identified easy labels and exploiting potential relevant labels. Extensive experimental results on the commonly used benchmark datasets show the proposed method significantly outperforms the SOTA methods., Comment: 12 pages, 5 figures

Background and Objective: Recent experimental studies using ultra-high dose rate radiation therapy (FLASH-RT) have shown improved normal tissue sparing and comparable tumor control compared to conventional dose rate RT. Pencil beam scanning (PBS) proton therapy with superior dosimetry characteristics has begun to draw attention to the delivery of conformal FLASH-RT for preclinical studies. This review aims to provide recent updates on the development of PBS FLASH-RT. Methods: The information summarized in this review article is based on search results in databases such as PubMed and search engines like Google Scholar, with keywords including pencil beam scanning, proton therapy, proton FLASH, Bragg peak FLASH, etc., with English articles from the year of 2014-2022. Content and Findings: This review summarizes of recent developments in PBS FLASH proton therapy (FLASH-PT), including PBS dose rate characterization, current delivery limitations, treatment planning, and biological investigations. Conclusions: As PBS FLASH delivery has enabled successful biological studies using transmission beams, the further improvement in PBS Bragg peak FLASH technologies will result in more advanced treatment plans associated with potentially improved outcomes.

Multi-Label Image Classification (MLIC) approaches usually exploit label correlations to achieve good performance. However, emphasizing correlation like co-occurrence may overlook discriminative features of the target itself and lead to model overfitting, thus undermining the performance. In this study, we propose a generic framework named Parallel Self-Distillation (PSD) for boosting MLIC models. PSD decomposes the original MLIC task into several simpler MLIC sub-tasks via two elaborated complementary task decomposition strategies named Co-occurrence Graph Partition (CGP) and Dis-occurrence Graph Partition (DGP). Then, the MLIC models of fewer categories are trained with these sub-tasks in parallel for respectively learning the joint patterns and the category-specific patterns of labels. Finally, knowledge distillation is leveraged to learn a compact global ensemble of full categories with these learned patterns for reconciling the label correlation exploitation and model overfitting. Extensive results on MS-COCO and NUS-WIDE datasets demonstrate that our framework can be easily plugged into many MLIC approaches and improve performances of recent state-of-the-art approaches. The explainable visual study also further validates that our method is able to learn both the category-specific and co-occurring features. The source code is released at https://github.com/Robbie-Xu/CPSD., Comment: accepted by IJCAI2022

Automatic image-based pavement distress detection and recognition are vital for pavement maintenance and management. However, existing deep learning-based methods largely omit the specific characteristics of pavement images, such as high image resolution and low distress area ratio, and are not end-to-end trainable. In this paper, we present a series of simple yet effective end-to-end deep learning approaches named Weakly Supervised Patch Label Inference Networks (WSPLIN) for efficiently addressing these tasks under various application settings. WSPLIN transforms the fully supervised pavement image classification problem into a weakly supervised pavement patch classification problem for solutions. Specifically, WSPLIN first divides the pavement image under different scales into patches with different collection strategies and then employs a Patch Label Inference Network (PLIN) to infer the labels of these patches to fully exploit the resolution and scale information. Notably, we design a patch label sparsity constraint based on the prior knowledge of distress distribution and leverage the Comprehensive Decision Network (CDN) to guide the training of PLIN in a weakly supervised way. Therefore, the patch labels produced by PLIN provide interpretable intermediate information, such as the rough location and the type of distress. We evaluate our method on a large-scale bituminous pavement distress dataset named CQU-BPDD and the augmented Crack500 (Crack500-PDD) dataset, which is a newly constructed pavement distress detection dataset augmented from the Crack500. Extensive results demonstrate the superiority of our method over baselines in both performance and efficiency. The source codes of WSPLIN are released on https://github.com/DearCaat/wsplin., Comment: Accepted by IEEE Transactions on Intelligent Transportation Systems

Adversarial training, originally designed to resist test-time adversarial examples, has shown to be promising in mitigating training-time availability attacks. This defense ability, however, is challenged in this paper. We identify a novel threat model named stability attack, which aims to hinder robust availability by slightly manipulating the training data. Under this threat, we show that adversarial training using a conventional defense budget $\epsilon$ provably fails to provide test robustness in a simple statistical setting, where the non-robust features of the training data can be reinforced by $\epsilon$-bounded perturbation. Further, we analyze the necessity of enlarging the defense budget to counter stability attacks. Finally, comprehensive experiments demonstrate that stability attacks are harmful on benchmark datasets, and thus the adaptive defense is necessary to maintain robustness. Our code is available at https://github.com/TLMichael/Hypocritical-Perturbation., Comment: NeurIPS 2022

Existing active learning studies typically work in the closed-set setting by assuming that all data examples to be labeled are drawn from known classes. However, in real annotation tasks, the unlabeled data usually contains a large amount of examples from unknown classes, resulting in the failure of most active learning methods. To tackle this open-set annotation (OSA) problem, we propose a new active learning framework called LfOSA, which boosts the classification performance with an effective sampling strategy to precisely detect examples from known classes for annotation. The LfOSA framework introduces an auxiliary network to model the per-example max activation value (MAV) distribution with a Gaussian Mixture Model, which can dynamically select the examples with highest probability from known classes in the unlabeled set. Moreover, by reducing the temperature $T$ of the loss function, the detection model will be further optimized by exploiting both known and unknown supervision. The experimental results show that the proposed method can significantly improve the selection quality of known classes, and achieve higher classification accuracy with lower annotation cost than state-of-the-art active learning methods. To the best of our knowledge, this is the first work of active learning for open-set annotation.