Search

The aim of image inpainting is to fill in damaged areas according to certain rules based on information about the adjacent positions of missing areas and the overall structure of the image, a technique that plays a key role in various tasks in computer vision. With the rapid development of deep learning, researchers have combined it with image inpainting and achieved excellent performance. To gain insight into the techniques involved, this paper summarizes the latest research advances in the field of image inpainting. Firstly, existing classical image inpainting methods are reviewed, and traditional image inpainting methods and their advantages and disadvantages are introduced. Secondly, three classical network models are outlined, and the image inpainting methods are classified into single-stage, multi-stage and a priori condition-guided approaches according to different network types and model structures. Representative algorithms among them are selected and their important technical improvement ideas are analyzed and summarized. Then, the common datasets commonly used in image inpainting tasks and the evaluation metrics used to evaluate inpainting results are introduced. The paper presents a comprehensive summary of the various algorithms in terms of network models and inpainting methods, and selects representative algorithms for quantitative and qualitative comparative analysis. Finally, the future development trends and research directions have prospected, and the current problems of image inpainting are summarized. [ABSTRACT FROM AUTHOR]

Advances in hardware capabilities and big data technologies over the past decade have enabled the application of deep learning techniques to address the challenge of super-resolution in remote-sensing images. Recently, while deep-learning-based methods have outperformed traditional methods, the abundance of information in remote-sensing images creates an imbalance between performance and computational resource consumption in current deep-learning-based methods. This paper introduces a stable super-resolution algorithm based on parameter reconstructive optimization to address these issues. First, based on the stable super-resolution generative adversarial network (SSRGAN), the algorithm employs a generator with networks using residual connections to reconstruct images with enhanced resolution. Next, it extracts content, adversarial, and regularization losses using the discriminator from a stable super-resolution generative adversarial network, which in turn guides the training of the network. Finally, upon completion of training, structural re-parameterization is conducted to optimize the multi-branch trained network into a plain inference network. This inference network can serve as an individual new generator. The results of qualitative and quantitative experimental comparisons with the models Bicubic, super-resolution convolutional neural network, very deep super-resolution convolutional network, deep recursive residual network, super-resolution generative adversarial network (SRGAN), enhanced SRGAN, and stable SRGAN on the Gaofen-5 AHSI satellite dataset suggest that this algorithm achieves improved evaluation indices with a 4× magnification ratio, reaching a peak signal-to-noise ratio of 30.7207 dB and structural similarity index measure of 0.8178. Compared with the trained but unconverted generator, which can also work independently, implementing re-parameterization results in approximately a 10% reduction in the number of parameters, indicating lower resource consumption, while the reconstruction effect is minimally influenced. Furthermore, the super-resolution results exhibit richer detail, increased contrast, and better scene adaptability. [ABSTRACT FROM AUTHOR]

This paper proposes a novel approach, BTC-SAGAN-CHA-MRI, for the classification of brain tumors using a SAGAN optimized with a Color Harmony Algorithm. Brain cancer, with its high fatality rate worldwide, especially in the case of brain tumors, necessitates more accurate and efficient classification methods. While existing deep learning approaches for brain tumor classification have been suggested, they often lack precision and require substantial computational time.The proposed method begins by gathering input brain MR images from the BRATS dataset, followed by a pre-processing step using a Mean Curvature Flow-based approach to eliminate noise. The pre-processed images then undergo the Improved Non-Sub sampled Shearlet Transform (INSST) for extracting radiomic features. These features are fed into the SAGAN, which is optimized with a Color Harmony Algorithm to categorize the brain images into different tumor types, including Gliomas, Meningioma, and Pituitary tumors. This innovative approach shows promise in enhancing the precision and efficiency of brain tumor classification, holding potential for improved diagnostic outcomes in the field of medical imaging. The accuracy acquired for the brain tumor identification from the proposed method is 99.29%. The proposed BTC-SAGAN-CHA-MRI technique achieves 18.29%, 14.09% and 7.34% higher accuracy and 67.92%,54.04%, and 59.08% less Computation Time when analyzed to the existing models, like Brain tumor diagnosis utilizing deep learning convolutional neural network with transfer learning approach (BTC-KNN-SVM-MRI); M3BTCNet: multi model brain tumor categorization under metaheuristic deep neural network features optimization (BTC-CNN-DEMFOA-MRI), and efficient method depending upon hierarchical deep learning neural network classifier for brain tumour categorization (BTC-Hie DNN-MRI) respectively. This paper proposes a novel approach, BTC-SAGAN-CHA-MRI, for the classification of brain tumors using a Self-Attention based Generative Adversarial Network (SAGAN) optimized with a Color Harmony Algorithm. Brain cancer, with its high fatality rate worldwide, especially in the case of brain tumors, necessitates more accurate and efficient classification methods. While existing deep learning approaches for brain tumor classification have been suggested, they often lack precision and require substantial computational time. The proposed method begins by gathering input brain MR images from the BRATS dataset, followed by a pre-processing step using a Mean Curvature Flow-based approach to eliminate noise. The pre-processed images then undergo the Improved Non-Sub sampled Shearlet Transform (INSST) for extracting radiomic features. These features are fed into the SAGAN, which is optimized with a Color Harmony Algorithm to categorize the brain images into different tumor types, including Gliomas, Meningioma, and Pituitary tumors. This innovative approach shows promise in enhancing the precision and efficiency of brain tumor classification, holding potential for improved diagnostic outcomes in the field of medical imaging. [ABSTRACT FROM AUTHOR]

Hyperspectral Unmixing (HU), which involves decomposing mixed pixels in hyperspectral images into endmembers and abundance fractions, plays a critical role in spectral analysis. Recent advancements in deep learning methods have shown successful applications in hyperspectral analysis. This paper proposes an end-to-end network structure that combines a Convolutional Neural Network (CNN) and a Multilayer Perceptron (MLP). The 3D-CNN extracts high-level features from both spatial and spectral neighbourhoods of hyperspectral image patches, while the MLP maps these abstracted features to abundance fractions. Considering the challenge of acquiring manual labels, we adopt a Semi-Supervised learning approach that leverages unlabelled data to enhance training. We divide our training data into labelled and unlabelled subsets, defining distinct loss functions for each. Additionally, we introduce a neighbourhood similarity constraint to fully exploit spatial context information. To address scenarios where no labelled data is available, we employ Generative Adversarial Networks (GANs) to generate synthetic labelled samples. Experimental evaluations conducted on both synthetic and real datasets validate the effectiveness of our proposed method, which outperforms several commonly used and state-of-the-art HU methods. [ABSTRACT FROM AUTHOR]

In recent years, the combination of deep learning and remote sensing has been a boiling state. However, because of the difference between remote sensing images and natural images, it is still an open question of whether deep learning methods can revolutionize remote sensing field. This work provides a brief review of 2674 related papers in deep learning with remote sensing (DL-RS) from 2014 to 2020. Keywords, publication years, journals, countries, and other essential characteristics of the papers were extracted. Also, we had set up some data items for information collection, such as remote sensing image categories, remote sensing applications, commonly used public datasets, and basic deep learning models. Our analysis shows that the number of research articles in DL-RS is still exploding, growing exponentially every year, and that DL methods have been applied to virtually all types of images and all applications of remote sensing. CNNs continue to be the most used deep learning model, accounting for 70% of all articles, GANs has now turned out to be the most used model after CNNs. Finally, we make some recommendations for future studies for the development of the DL-RS field. [ABSTRACT FROM AUTHOR]

The economic, social, cultural growth of most developing countries depends upon the agriculture sector. However, plant disease may lead to inferior crop yield economic growth. Various computer vision and artificial intelligence-based schemes have been presented in past for automatic plant leaf disease detection but their performance is inadequate due to underprivileged feature representation, lower-order correlation of raw features, data imbalance problem, less generalization. This paper presents automatic plant leaf disease detection using Deep Convolutional Neural Network (DCNN) to increase the feature representation and correlation and Generative Adversarial Network (GAN) for data augmentation to cope up with data imbalance problem. Extensive experimentations are performed on ten classes of tomato plant disease from Plant Village leaf disease database. Effectiveness of proposed scheme is evaluated based on accuracy, precision, recall, F1 score which has shown momentous improvement over customary methods for plant leaf disease database (Accuracy- 99.74%, precision- 0.99, recall-0.99, F1 score -0.99). [ABSTRACT FROM AUTHOR]

In this paper, a robust compressed sensing image encryption algorithm based on generative adversarial network, convolutional neural network (CNN) denoising network and chaotic system is developed. Firstly, we use a sampling network to get the measurement of plain image. Second, the cipher image is obtained by scrambling the measurement through the Logistic-Tent chaotic system. After getting cipher image, the decryption party obtains decrypted measurement by inverse scrambling the cipher image, and then sends it to the reconstruction network to obtain decrypted reconstructed image. Finally, by using the CNN denoiser, the image quality and the visual expression of final decrypted image can be improved. In this scheme, the dual denoiser structure based on reconstruction network and CNN denoiser can effectively resist noise attacks. Besides, the proposed training strategy with noise injection can further improve the robustness of network. Experiments show our method has high reconstruction quality, efficiency, robustness and security. [ABSTRACT FROM AUTHOR]