Search

We propose a unified game-theoretical framework to perform classification and conditional image generation given limited supervision. It is formulated as a three-player minimax game consisting of a generator, a classifier and a discriminator, and therefore is referred to as Triple Generative Adversarial Network (Triple-GAN). The generator and the classifier characterize the conditional distributions between images and labels to perform conditional generation and classification, respectively. The discriminator solely focuses on identifying fake image-label pairs. Theoretically, the three-player formulation guarantees consistency. Namely, under a nonparametric assumption, the unique equilibrium of the game is that the distributions characterized by the generator and the classifier converge to the data distribution. As a byproduct of the three-player formulation, Triple-GAN is flexible to incorporate different semi-supervised classifiers and GAN architectures. We evaluate Triple-GAN in two challenging settings, namely, semi-supervised learning and the extremely low data regime. In both settings, Triple-GAN can achieve excellent classification results and generate meaningful samples in a specific class simultaneously. In particular, using a commonly adopted 13-layer CNN classifier, Triple-GAN outperforms extensive semi-supervised learning methods substantially on several benchmarks no matter data augmentation is applied or not. [ABSTRACT FROM AUTHOR]

Conditional Generative Adversarial Networks (cGANs) have enabled controllable image synthesis for many vision and graphics applications. However, recent cGANs are 1-2 orders of magnitude more compute-intensive than modern recognition CNNs. For example, GauGAN consumes 281G MACs per image, compared to 0.44G MACs for MobileNet-v3, making it difficult for interactive deployment. In this work, we propose a general-purpose compression framework for reducing the inference time and model size of the generator in cGANs. Directly applying existing compression methods yields poor performance due to the difficulty of GAN training and the differences in generator architectures. We address these challenges in two ways. First, to stabilize GAN training, we transfer knowledge of multiple intermediate representations of the original model to its compressed model and unify unpaired and paired learning. Second, instead of reusing existing CNN designs, our method finds efficient architectures via neural architecture search. To accelerate the search process, we decouple the model training and search via weight sharing. Experiments demonstrate the effectiveness of our method across different supervision settings, network architectures, and learning methods. Without losing image quality, we reduce the computation of CycleGAN by 21×, Pix2pix by 12×, MUNIT by 29×, and GauGAN by 9×, paving the way for interactive image synthesis. [ABSTRACT FROM AUTHOR]

Recently, various fault diagnosis methods based on domain adaptation (DA) have been explored to solve the problem of discrepancy between the source and target domains. However, given complex industrial scenarios, DA-based methods usually fail when the working conditions of machines are unseen, i.e., target data are unavailable during model training. In this article, a generic domain-regressive framework for fault diagnosis, namely, adversarial domain-invariant generalization (ADIG), is proposed. ADIG leverages multiple available domain data to exploit domain-invariant knowledge through adversarial learning between the feature extractor and the domain classifier. Simultaneously, the fault classifier generalizes the knowledge from the source-related domain to diagnose the unseen but related target domain signals. Moreover, customized strategies of feature normalization and adaptive weight are proposed to promote diagnosis performance. Comprehensive case studies show that ADIG achieves satisfactory diagnosis accuracy and robustness under unseen conditions, indicating that ADIG is a remarkably potential diagnosis tool for real-case industrial machines. [ABSTRACT FROM AUTHOR]