Search

The rotating synthetic aperture (RSA) optical imaging system employs a rectangular primary mirror for detection. During the imaging process, the primary mirror rotates around the center to achieve the aperture equivalent to the long side of the rectangle at different rotation angles. As a result, the system's point spread function changes over time, causing periodic time-varying characteristics in the acquired images' resolution. Moreover, due to the rectangular primary mirror, the images obtained by the RSA system are spatially asymmetric, with a lower resolution in the short side's direction than in the long side's direction. Hence, image processing techniques are necessary to enhance the image quality. To provide reference for the study of image quality improvement methods, we first characterize the imaging quality degradation mechanism of the RSA system and the time–space evolution law of the imaging process. We then establish an imaging experiment platform to simulate the dynamic imaging process of the RSA system. We quantify the RSA system's impact on image degradation using objective indexes. Subsequently, by comparing the imaging experiment results with theoretical analysis, we verify the spatially asymmetric and temporally periodic imaging characteristics of the RSA system. Lastly, we introduce image super-resolution experiments to assess the limitations of directly applying generic deep learning-based single image super-resolution methods to the images captured by the RSA system, thereby revealing the challenges involved in improving image quality for the RSA system. [ABSTRACT FROM AUTHOR]

The novel rotating synthetic aperture (RSA) is a new optical imaging system that uses the method of rotating the rectangular primary mirror for dynamic imaging. It has the advantage of being lightweight, with no need for splicing and real-time surface shape maintenance on orbit. The novel imaging method leads to complex image quality degradation characteristics. Therefore, it is vital to use the image quality improvement method to restore and improve the image quality to meet the application requirements. For the RSA system, a new system that has not been applied in orbit, it is difficult to construct suitable large datasets. Therefore, it is necessary to study and establish the dynamic imaging characteristic model of the RSA system, and on this basis provide data support for the corresponding image super resolution and restoration method through simulation. In this paper, we first analyze the imaging characteristics and mathematically model the rectangular rotary pupil of the RSA system. On this basis, combined with the analysis of the physical interpretation of the blur kernel, we find that the optimal blur kernel is not the point spread function (PSF) of the imaging system. Therefore, the simulation method of convolving the input image directly with the PSF is flawed. Furthermore, the weights of a convolutional neural network (CNN) are the same for each input. This means that the normal convolutional layer is not only difficult to accurately estimate the time-varying blur kernel, but also difficult to adapt to the change in the length–width ratio of the primary mirror. To that end, we propose a blur kernel estimation conditional convolutional neural network (CCNN) that is equivalent to multiple normal CNNs. We extend the CNN to a conditional model by taking an encoding as an additional input and using conditionally parameterized convolutions instead of normal convolutions. The CCNN can simulate the imaging characteristics of the rectangular pupil with different length–width ratios and different rotation angles in a controllable manner. The results of semi-physical experiments show that the proposed simulation method achieves a satisfactory performance, which can provide data and theoretical support for the image restoration and super-resolution method of the RSA system. [ABSTRACT FROM AUTHOR]

Diffractive membrane imaging systems have been an important development trend for high-orbit satellite cameras owing to their advantages of large aperture, light weight, rapid manufacture, and low cost. However, caused by the cross-coupling effects of diffraction imaging, membrane properties, subaperture stitching, on-orbit disturbances, and other physical factors, lager-aperture space diffractive membrane imaging systems have specific and complex degradation characteristics: the modulation transfer function (MTF) and signal-to-noise ratio (SNR) have more prominent degradation and serious space-variant characteristics over fields of view, with obvious background radiation properties that seriously affect the application of imaging products. To address this problem, this study established a global information transmission model by characterizing the PSF and background radiation in a full field of view to represent the imaging law of an on-orbit system. Aiming at the inverse problem of the information transmission model, we also propose a novel image inversion restoration method for the special degradation characteristics. In particular, the effect of diffraction efficiency is introduced into the inversion restoration method to solve the background radiation problem. Moreover, we innovatively designed matrix regularization parameters to further improve the correction ability of spatial variation. When the diffraction efficiency was experimentally higher than 60% and the mean measured spatial variability was less than 0.2, the proposed method exhibited a satisfactory processing performance, and could improve multiobjective comprehensive processing, such as transfer function compensation, spatial variation correction, and background radiation removal. [ABSTRACT FROM AUTHOR]

The diffractive membrane optical imaging system is an important development trend of ultra large aperture and lightweight space camera. However, related investigations on physics-based diffractive imaging degradation characteristics and corresponding image restoration methods are less studied. In this paper, the model of image quality degradation for the diffraction imaging system is first deduced mathematically based on diffraction theory and then the degradation characteristics are analyzed. On this basis, a novel regularization model of image restoration that contains multiple prior constraints is established. After that, the solving approach of the equation with the multi-norm coexistence and multi-regularization parameters (prior’s parameters) is presented. Subsequently, the space-variant PSF image restoration method for large aperture diffractive imaging system is proposed combined with block idea of isoplanatic region. Experimentally, the proposed algorithm demonstrates its capacity to achieve multi-objective improvement including MTF enhancing, dispersion correcting, noise and artifact suppressing as well as image’s detail preserving, and produce satisfactory visual quality. This can provide scientific basis for applications and possesses potential application prospects on future space applications of diffractive membrane imaging technology. [ABSTRACT FROM AUTHOR]

The novel rotating synthetic aperture imaging system has the advantages of short processing cycle, light weight, low cost, and convenient transport, which is a potential development direction for future optical satellite payloads with ultra-large aperture. However, influenced by the coupling effects of the rectangular primary mirror, rotating imaging, and link perturbation, images from this system may have unique spatial and temporal variability with resolution anisotropy, resulting in the dynamics and weak features of targets. The insufficient recognition of system characteristics seriously restricts the application ability of corresponding target interpretation methods. To address this problem, we start with the analysis of system imaging characteristics and target interpretation mechanisms. Considering calculating texture, grayscale, and edge feature parameters in evaluation regions of different sizes, we propose a degradation assessment method based on multi-scale feature characterization. Then, combined with the theoretical calculation and practical target detection experiments, the influence of crucial parameters such as the aspect ratio and rotation angle of the primary mirror on the target interpretation capability is analyzed. The results will provide guidance for the integrated design and optimization of optical imaging systems and intelligent image processing methods. • A degradation assessment method based on multi-scale feature characterization is proposed. • The effect of rotating synthetic aperture system on image target characteristic degradation is analyzed. • The impacts of key system parameters on target detection performance are analyzed. [ABSTRACT FROM AUTHOR]

• The imaging mechanism of the novel rotating synthetic aperture system is deduced. • The image degradation model of the rotating synthetic aperture system is presented. • The effects of factors causing image quality degradation are analyzed. The Rotating synthetic aperture (RSA) is one of the most promising novel imaging systems to meet the requirements of lightweight and high resolution for optical remote sensing satellites, especially in geostationary orbit. The point spread function (PSF) orientation relative to the observed scene, intentionally changes to measure all spatial frequency information available to a filled circular aperture having a diameter approximately equal to the length of the rectangular aperture. As with all precision optical systems, RSA is also subject to dynamic disturbances from the spacecraft/environment. If not accommodated properly in the measurement and synthesis process, the dynamic disturbances can result in significant image quality degradation. To quantify methods to reduce or eliminate the errors, we first analyze the on-orbit imaging mechanism of the RSA system theoretically and then represent the worst-case on-orbit imaging degradation characteristics. [ABSTRACT FROM AUTHOR]

Rotating Synthetic Aperture (RSA) technology is one of the distinctly advantageous Earth geostationary orbit optical remote sensing technologies. However, the continuous rotation of the RSA system's rectangular primary mirror results in a discernible drop in resolution along the shorter side of the mirror. Additionally, the captured images exhibit periodic and time-varying characteristics. To improve the image quality to meet interpretation needs, we first delineate the imaging process of the rotating primary mirror and analyze the characteristics of image degradation based on the system's imaging mechanism. Then, we propose a dual super-resolution (SR) framework based on Swin Transformer and introduce a self-supervised learning method for jointly training the unified SR network using wavelet fusion. The self-supervised learning method effectively utilizes the spatiotemporal correlation of the information contained in images captured at different rotation directions of the rectangular pupil. Moreover, the attention mechanism in Transformer can adopt a global perspective and utilize content-based interactions between image content and attention weights to model strong long-range dependencies in remote sensing images. This approach significantly enhances image quality along the pupil's shorter side, consequently yielding superior results. Extensive digital and semi-physical imaging experiments, involving six aspect ratios of the primary mirror, demonstrate that our SR method surpasses state-of-the-art methods. The work in this paper can serve as a valuable reference for future space applications of the RSA technology. • Analyzing the imaging mechanisms of the rotating synthetic aperture system. • Self-supervised learning enhances the utilization of image internal information. • Designing a dual framework that can be trained jointly for image super resolution. • Interactions between image content and attention weights improve performance. • Performance is evaluated through digital and semi-physical experiments. [ABSTRACT FROM AUTHOR]

• Regularization model with multiple prior constraints and matrixing confidence parameters was established. • The approach to solving the equation with multi-norm coexistence was presented. • The effect of diffraction efficiency on restored images was analyzed. We proposed a novel inversion restoration method for the newly developing space diffractive membrane imaging system, in which specific imaging characteristics were first integrated into the degradation model. On this basis, a novel image inversion restoration model was established based on sparse regularization frames and matrixing confidence parameters. Then, an efficient solution method was proposed using an improved iterative shrinkage-thresholding algorithm. Experimentally, when the diffraction efficiency was higher than 60%, the proposed inversion restoration method exhibited a satisfactory processing performance, and could achieve multi-objective image quality improvement, including texture detail restoration, background radiation removal, and noise suppression. [ABSTRACT FROM AUTHOR]

• Analyzing the imaging characteristics of the rotating synthetic aperture system. • Intra-frame self-attention enhances the utilization of spatial information. • Inter-frame mutual attention enhances the utilization of temporal information. • Interactions between image content and attention weights improve performance. • Performance is evaluated through digital and semi-physical experiments. Rotating synthetic aperture (RSA) technology offers a promising solution for achieving large-aperture and lightweight designs in optical remote-sensing systems. It employs a rectangular primary mirror, resulting in noncircular spatial symmetry in the point-spread function, which changes over time as the mirror rotates. Consequently, it is crucial to employ an appropriate image-fusion method to merge high-resolution information intermittently captured from different directions in the image sequence owing to the rotation of the mirror. However, existing image-fusion methods have struggled to address the unique imaging mechanism of this system and the characteristics of the geostationary orbit in which the system operates. To address this challenge, we model the imaging process of a noncircular rotating pupil and analyse its on-orbit imaging characteristics. Based on this analysis, we propose an image-fusion network based on a vision transformer. This network incorporates inter-frame mutual attention and intra-frame self-attention mechanisms, facilitating more effective extraction of temporal and spatial information from the image sequence. Specifically, mutual attention was used to model the correlation between pixels that were close to each other in the spatial and temporal dimensions, whereas long-range spatial dependencies were captured using intra-frame self-attention in the rotated variable-size attention block. We subsequently enhanced the fusion of spatiotemporal information using video swin transformer blocks. Extensive digital simulations and semi-physical imaging experiments on remote-sensing images obtained from the WorldView-3 satellite demonstrated that our method outperformed both image-fusion methods designed for the RSA system and state-of-the-art general deep learning-based methods. 1 1 Dataset is available at https://github.com/sherlockyusun/RSA-Fuse. [ABSTRACT FROM AUTHOR]