Search

Salient object detection is a method of finding an object within an image that a person determines to be important and is expected to focus on. Various features are used to compute the visual saliency, and in general, the color and luminance of the scene are widely used among the spatial features. However, humans perceive the same color and luminance differently depending on the influence of the surrounding environment. As the human visual system (HVS) operates through a very complex mechanism, both neurobiological and psychological aspects must be considered for the accurate detection of salient objects. To reflect this characteristic in the saliency detection process, we have proposed two pre-processing methods to apply to the input image. First, we applied a bilateral filter to improve the segmentation results by smoothing the image so that only the overall context of the image remains while preserving the important borders of the image. Second, although the amount of light is the same, it can be perceived with a difference in the brightness owing to the influence of the surrounding environment. Therefore, we applied oriented difference-of-Gaussians (ODOG) and locally normalized ODOG (LODOG) filters that adjust the input image by predicting the brightness as perceived by humans. Experiments on five public benchmark datasets for which ground truth exists show that our proposed method further improves the performance of previous state-of-the-art methods.

With the recent development of video compression methods, video transmission on traditional devices and video distribution using networks has increased in various devices such as drones, IP cameras, and small IoT devices. As a result, the demand for encryption techniques such as MPEG-DASH for transmitting streams over networks is increasing. These video stream security methods guarantee stream confidentiality. However, they do not hide the fact that the encrypted stream is being transmitted over the network. Considering that sniffing attacks can analyze the entropy of the stream and scan huge amounts of traffic on the network, to solve this problem, the deception method is required, which appears unencrypted but a confidential stream. In this paper, we propose the new deception method that utilizes standard NAL unit rules of video codec, where the unpromised device shows the cover video and the promised device shows the secret video for deceptive security. This method allows a low encryption cost and the stream to dodge entropy-based sniffing scan attacks. The proposed stream shows that successful decoding using five standard decoders and processing performance was 61% faster than the conventional encryption method in the test signal conformance set. In addition, a network encrypted stream scan method the HEDGE showed classification results that our stream is similar to a compressed video.

Ultrasound imaging has been used for diagnosing lesions in the human body. In the process of acquiring ultrasound images, speckle noise may occur, affecting image quality and auto-lesion classification. Despite the efforts to resolve this, conventional algorithms exhibit poor speckle noise removal and edge preservation performance. Accordingly, in this study, a novel algorithm is proposed based on speckle reducing anisotropic diffusion (SRAD) and a Bayes threshold in the wavelet domain. In this algorithm, SRAD is employed as a preprocessing filter, and the Bayes threshold is used to remove the residual noise in the resulting image. Compared to the conventional filtering techniques, experimental results showed that the proposed algorithm exhibited superior performance in terms of peak signal-to-noise ratio (average = 28.61 dB) and structural similarity (average = 0.778).

Super-Resolution (SR) is a fundamental computer vision task that aims to obtain a high-resolution clean image from the given low-resolution counterpart. This paper reviews the NTIRE 2021 Challenge on Video Super-Resolution. We present evaluation results from two competition tracks as well as the proposed solutions. Track 1 aims to develop conventional video SR methods focusing on the restoration quality. Track 2 assumes a more challenging environment with lower frame rates, casting spatio-temporal SR problem. In each competition, 247 and 223 participants have registered, respectively. During the final testing phase, 14 teams competed in each track to achieve state-of-the-art performance on video SR tasks.

International audience; This paper reviews the Challenge on Image Demoireing that was part of the New Trends in Image Restoration and Enhancement (NTIRE) workshop, held in conjunction with CVPR 2020. Demoireing is a difficult task of removing moire patterns from an image to reveal an underlying clean image. The challenge was divided into two tracks. Track 1 targeted the single image demoireing problem, which seeks to remove moire patterns from a single image. Track 2 focused on the burst demoireing problem, where a set of degraded moire images of the same scene were provided as input, with the goal of producing a single demoired image as output. The methods were ranked in terms of their fidelity, measured using the peak signal-to-noise ratio (PSNR) between the ground truth clean images and the restored images produced by the participants' methods. The tracks had 142 and 99 registered participants, respectively, with a total of 14 and 6 submissions in the final testing stage. The entries span the current state-of-the-art in image and burst image demoireing problems. © 2020 IEEE.

Motion blur is one of the most common degradation artifacts in dynamic scene photography. This paper reviews the NTIRE 2020 Challenge on Image and Video Deblurring. In this challenge, we present the evaluation results from 3 competition tracks as well as the proposed solutions. Track 1 aims to develop single-image deblurring methods focusing on restoration quality. On Track 2, the image deblurring methods are executed on a mobile platform to find the balance of the running speed and the restoration accuracy. Track 3 targets developing video deblurring methods that exploit the temporal relation between input frames. In each competition, there were 163, 135, and 102 registered participants and in the final testing phase, 9, 4, and 7 teams competed. The winning methods demonstrate the state-of-the-art performance on image and video deblurring tasks.

Many deep-learning-based image/video denoising models have been developed, and recently, several approaches for training a denoising neural network without using clean images have been proposed. However, Noise2Noise method requires paired noisy data, and obtaining them is occasionally difficult, whereas other existing models trained using unpaired noisy data deliver limited performance. Obtaining an accurate optical flow from noisy videos is also a difficult task because conventional optical flow estimation methods are primarily focused on estimating the optical flow using clean videos. This study proposes a new framework to fine-tune video denoising and optical flow estimation networks using unpaired noisy videos. These two networks are jointly trained to realize synergy; an improvement in the denoising performance increases the accuracy of the flow estimation, and an improvement in the flow-estimation performance enhances the quality of the training data for the denoiser. Our experimental results reveal that proposed approach outperforms the existing training schemes in video denoising and also provides accurate optical flows even when the videos contain a considerable amount of noise.

This paper reviews the NTIRE 2020 challenge on real image denoising with focus on the newly introduced dataset, the proposed methods and their results. The challenge is a new version of the previous NTIRE 2019 challenge on real image denoising that was based on the SIDD benchmark. This challenge is based on a newly collected validation and testing image datasets, and hence, named SIDD+. This challenge has two tracks for quantitatively evaluating image denoising performance in (1) the Bayer-pattern rawRGB and (2) the standard RGB (sRGB) color spaces. Each track ~250 registered participants. A total of 22 teams, proposing 24 methods, competed in the final phase of the challenge. The proposed methods by the participating teams represent the current state-of-the-art performance in image denoising targeting real noisy images. The newly collected SIDD+ datasets are publicly available at: https://bit.ly/siddplus_data.

In this paper, a novel algorithm is proposed using speckle reducing anisotropic diffusion (SRAD) and gradient domain guided image filtering (GDGIF) to reduce speckle in synthetic aperture radar (SAR) images. SRAD is suitable for reducing multiplicative noise in SAR images because it can directly process log-compressed data. Since GDGIF has edge-aware weighting, it is adaptively applied to SRAD result images to additionally reduce speckle noise. Experimental results demonstrate that the proposed algorithm, compared to existing filtering methods, shows excellent speckle noise reduction performance and a low computational complexity.

Deep convolutional neural networks have been used extensively in recent image processing research, exhibiting drastically improved performance. In this study, we apply convolutional neural networks to color filter array demosaicking, which plays an essential role in single-sensor digital cameras. Contrary to conventional convolutional neural network-based demosaicking models, the proposed model does not require any initial interpolation step for mosaicked input images, which increases the computational complexity. Using a mosaicked image as input, the proposed model is trained in an end-to-end manner to generate demosaicked images outputs. Many deep neural networks experience vanishing-gradient problem, which makes models hard to be trained. To solve this problem, we apply residual learning and densely connected convolutional neural network. Moreover, we apply block-wise convolutional neural networks to consider local features. Finally, we apply a sub-pixel interpolation layer to generate demosaicked output images more efficiently and accurately. Experimental results show that our proposed model outperforms conventional solutions and state-of-the-art models.

Synthetic aperture radar (SAR) images are difficult to analyze due to speckle noise, which is a characteristic of multiplicative noise. Over the last few decades, a number of studies have been performed regarding the removal of speckle noise. However, the existing studies exhibit edge information loss when removing speckle noise. In this paper, we propose an algorithm using speckle reducing anisotropic diffusion (SRAD), soft thresholding, and a guided filter to effectively remove speckle noise from SAR images while preserving edge information. The proposed algorithm first obtains a filtered image by applying an SRAD filter to a noise image. To further remove the multiplicative noise remaining in the filtered image, a logarithmic transformation is applied to convert it into additive noise. The filtering image was decomposed into multiresolution images using discrete wavelet transform (DWT). Soft thresholding and a guided filter were used for each of the high-frequency subimages and the low-frequency subimage. Then, an inverse DWT and an exponential transform are applied to the denoised image. The experimental results indicate that the proposed algorithm shows better performance than the conventional filtering method in terms of both objective and subjective performances.

High Efficiency Video Coding (HEVC) is a state-of-the-art video compression standard which improves coding efficiency significantly compared with the previous coding standard, H.264/AVC. In the HEVC standard, novel technologies consuming massive computational power are adopted, such as quad-tree-based coding unit (CU) partitioning. Although an HEVC encoder can efficiently compress various video sequences, the computational complexity of an exhaustive search has become a critical problem in HEVC encoder implementation. In this paper, we propose a fast algorithm for the CU partitioning process of the HEVC encoder using machine learning methods. A complexity measure based on the Sobel operator and rate-distortion costs are defined as features for our algorithm. A CU size can be determined early by employing Fisher’s linear discriminant analysis and the k-nearest neighbors classifier. The statistical data used for the proposed algorithm is updated by adaptive online learning phase. The experimental results show that the proposed algorithm can reduce encoding time by approximately 54.0% with a 0.68% Bjontegaard-Delta bit-rate increase.

In this paper, we propose a new demosaicking system that uses post-processing technique to remove zipper artifacts that are primarily caused by improper interpolation in a quincunx-sampled green plane. We use a high-order approximation to predict accurate pixel values in the weighted average-based green channel interpolation. We also perform prediction using a color difference model in the red and blue channel interpolation process. As a well-designed demosaicking system too cannot prevent the occurrence of ON–OFF pattern artifacts and the resulting false colors, we propose post-processing for zipper artifact detection and removal to improve the demosaicked image. After performing the just noticeable difference model-based zipper artifact detection in the luminance image of the demosaicked image, the clamping-based zipper artifact removal process is performed in the red, green, and blue planes. Experimental results demonstrate that the proposed demosaicking system improves both the objective and subjective image qualities compared to the conventional state-of-the-art demosaicking algorithms.

This paper proposes a thumbnail quality enhancement algorithm that uses a predefined weight table. Conventional thumbnail extraction algorithms in high efficiency video coding use a simple downsampling method to produce thumbnail images with low complexity, resulting in thumbnail quality deterioration. The proposed algorithm estimates the original average values of each thumbnail pixel using a weighted average value of several pixels, based on intra-mode direction. The proposed method improves the visual quality of thumbnail images while maintaining low complexity.

This paper reviews the first AIM challenge on mapping camera RAW to RGB images with the focus on proposed solutions and results. The participating teams were solving a real-world photo enhancement problem, where the goal was to map the original low-quality RAW images from the Huawei P20 device to the same photos captured with the Canon 5D DSLR camera. The considered problem embraced a number of computer vision subtasks, such as image demosaicing, denoising, gamma correction, image resolution and sharpness enhancement, etc. The target metric used in this challenge combined fidelity scores (PSNR and SSIM) with solutions' perceptual results measured in a user study. The proposed solutions significantly improved baseline results, defining the state-of-the-art for RAW to RGB image restoration.

Video frame interpolation has been studied for a long time; however, it is still a difficult low-level vision task. Owing to the improved performance of optical flow estimation, frame-interpolation studies based on optical flow are actively conducted. However, the existing methods are generally tested using high-fps sequences and developed for 2× upscaling or generating multiple frames with a single estimator. This paper proposes a 4× video-interpolation framework that aims to convert 15-fps to 60-fps videos based on a structure comprising flow estimation followed by an enhancement network. We improve the performance by training specialized flow estimators for each direction and frame position. Furthermore, we use the original frames and flow maps as additional inputs for the enhancement network to improve the subjective image quality. Consequently, the proposed network interpolates high-quality frames with a fast runtime and demonstrates its superiority in the AIM 2019 video temporal super-resolution challenge. The associated code is available at https://github.com/SonghyunYu/PoSNet.

Videos contain various types and strengths of motions that may look unnaturally discontinuous in time when the recorded frame rate is low. This paper reviews the first AIM challenge on video temporal super-resolution (frame interpolation) with a focus on the proposed solutions and results. From low-frame-rate (15 fps) video sequences, the challenge participants are asked to submit higher-frame-rate (60 fps) video sequences by estimating temporally intermediate frames. We employ the REDS_VTSR dataset derived from diverse videos captured in a hand-held camera for training and evaluation purposes. The competition had 62 registered participants, and a total of 8 teams competed in the final testing phase. The challenge winning methods achieve the state-of-the-art in video temporal super-resolution.

It is difficult to apply most video temporal super-resolution studies for real-world scenes because they are optimized for a specific range of characteristics. In this paper, we propose a video temporal super-resolution method that is tolerant to motion diversity and noise. Our proposed method improves its robustness by fine-tuning the pre-trained SPyNet that is trained for videos with simple motions and moderate conditions. Moreover, our proposed network learns to accurately synthesize two frames generated by a backward warping function without requiring any additional information using the architecture of a modified DHDN. This enables our proposed method to efficiently synthesize two warped frames by saving the computational complexity for pre-training and extracting the additional information. Finally, we apply the self-ensemble method, which is commonly used in studies on image processing but not on video processing. The application of the self-ensemble method enables our network to generate stable output frames with improved quality without any additional training. Our proposed network proved its performance by ranking 5th in the AIM 2019 video temporal super-resolution challenge; the performance gap between our proposed network and the 3rd-and 4th-ranked solutions was very small. The source code and pre-trained models are available at https://github.com/BumjunPark/DVTSR.

Networks using down-scaling and up-scaling of feature maps have been studied extensively in low-level vision research owing to efficient GPU memory usage and their capacity to yield large receptive fields. In this paper, we propose a deep iterative down-up convolutional neural network (DIDN) for image denoising, which repeatedly decreases and increases the resolution of the feature maps. The basic structure of the network is inspired by U-Net which was originally developed for semantic segmentation. We modify the down-scaling and up-scaling layers for image denoising task. Conventional denoising networks are trained to work with a single-level noise, or alternatively use noise information as inputs to address multi-level noise with a single model. Conversely, because the efficient memory usage of our network enables it to handle multiple parameters, it is capable of processing a wide range of noise levels with a single model without requiring noise-information inputs as a work-around. Consequently, our DIDN exhibits state-of-the-art performance using the benchmark dataset and also demonstrates its superiority in the NTIRE 2019 real image denoising challenge.

Recently, deep convolutional neural networks have been applied in numerous image processing researches and have exhibited drastically improved performances. In this study, we introduce a densely connected hierarchical image denoising network (DHDN), which exceeds the performances of state-of-the-art image denoising solutions. Our proposed network improves the image denoising performance by applying the hierarchical architecture of the modified U-Net; this makes our network to use a larger number of parameters than other methods. In addition, we induce feature reuse and solve the vanishing-gradient problem by applying dense connectivity and residual learning to our convolution blocks and network. Finally, we successfully apply the model ensemble and self-ensemble methods; this enable us to improve the performance of the proposed network. The performance of the proposed network is validated by winning the second place in the NTRIE 2019 real image denoising challenge sRGB track and the third place in the raw-RGB track. Additional experimental results on additive white Gaussian noise removal also establishes that the proposed network outperforms conventional methods; this is notwithstanding the fact that the proposed network handles a wide range of noise levels with a single set of trained parameters.

In the process of obtaining synthetic aperture radar (SAR) images, speckle noise exhibited in the SAR images. Speckle noise in the SAR images degrades an image quality and become difficult to interpret the image. Speckle noise reduction technique is a crucial step for using various application of SAR images. In this paper, we proposed a novel algorithm based on speckle reducing anisotropic diffusion (SRAD) and weighted least squares (WLS) filter for removing speckle noise and preserving edge information. The SRAD filter is applied as a preprocessing filter. A logarithmic transformation employed to convert a multiplicative noise remaining in the SRAD filter result image. The multiplicative noise changed as an additive noise. The additive noise in the SRAD filtering result image removed by the WLS filter. We can obtain a despeckled image employing an exponential transform. Experimental results demonstrate that the proposed method exhibits the best speckle noise reduction and edge preservation performance than the conventional filtering techniques.

In this paper, we introduce an efficient image demosaicking method using a bilateral filter and directional differentiation with consideration of both the spatial closeness and the similarity between the interpolated pixel and the neighbor pixels. Spatial closeness is considered as spatial locality. We utilize an adaptive weighted average to estimate the missing pixel value, where the adaptive weight is calculated based on three components: directional differentiation, similarity between the pixel and each of its neighbor pixels, and spatial locality. The experimental results show that the proposed method outperforms existing approaches in both objective and subjective performance.

The wavelet domain Wiener filter has been widely adopted as an effective image denoising method that has low complexity. In this paper we propose a novel Wiener filter with high-resolution estimation that determines the signal power while preserving the edge information. We assume that a noisy image is composed of noise and the original image, which are mutually orthogonal. Based on this assumption, we utilize the local covariance to obtain high-resolution coefficients from the low-resolution coefficients and to estimate the signal variance in the Wiener filter by using the high resolution values. The experimental results show that the proposed algorithm improves the objective and subjective performance significantly.

최근 넓은 동적 영역 이미지 기술은 컴퓨터 그래픽 분야에서 화제다. 본 논문에서는 가중 최소자승(가중회귀분석) 최적화 체계에 기반하여 넓은 동적 영역 이미지를 처리하는 톤매핑 알고리듬을 제안한다. 제안하는 방법은 시각적 후광 현상을 피하는 동시에 기존의 디스플레이에서 더 지각적인 넓은 동적 영역 이미지들을 보여주기 위해 가중 최소자승 필터링과 iCAM06모델을 결합한다. 제안된 알고리듬은 먼저 넓은 동적 영역 이미지를 base layer와 detail layer로 나눈다. Base layer는 큰 규모의 변화량을 가지고 있으며 가중 최소자승 필터링을 사용하여 얻어지고 iCAM06 모델을 포함한다. 다음으로, 인간의 시각 체계에 따라 base layer는 적응적으로 압축된다. 압축 시에는 base layer만 대비를 줄이고 detail layer을 보존한다. 본 논문에서는 객관적 화질 평가와 주관적 화질 평가를 통하여 제안하는 알고리듬을 적용한 이미지가 기존의 알고리듬을 적용한 이미지들에 비해 원본 넓은 동적 영역 이미지에 더 유사하다는 것을 보여준다.

In this paper, we propose a four-direction residual interpolation (FDRI) method for color filter array interpolation. The proposed algorithm exploits a guided filtering process to generate the tentative image. The residual image is generated by exploiting the tentative and original images. We use an FDRI algorithm to more accurately estimate the missing pixel values; the estimated image is adaptively combined with a joint inverse gradient weight. Based on the experimental results, the proposed method provides a superior performance in terms of objective and subjective quality compared with the conventional state-of-the-art demosaicking methods.

This paper reviews the NTIRE 2019 challenge on real image denoising with focus on the proposed methods and their results. The challenge has two tracks for quantitatively evaluating image denoising performance in (1) the Bayer-pattern raw-RGB and (2) the standard RGB (sRGB) color spaces. The tracks had 216 and 220 registered participants, respectively. A total of 15 teams, proposing 17 methods, competed in the final phase of the challenge. The proposed methods by the 15 teams represent the current state-of-the-art performance in image denoising targeting real noisy images.

In this paper, we propose image demosaicking model using densely connected convolutional neural network. Recently, deep neural networks show improved results in image processing field compared with conventional algorithms. However, they often suffer vanishing-gradient problem which makes models hard to be trained. To solve this problem, we applied densely connected convolutional neural network. More than that, our proposed network doesn't need any initial interpolation which can reduce computational complexity. Finally, we applied sub-pixel interpolation layer which can generate demosaicked output image efficiently and accurately. Experimental results show that our proposed model outperformed conventional methods.

Guided image filter (GIF) is proposed for manipulating the high dynamic range (HDR) image. In the conventional algorithm, it is used to divide an image into a base layer and a detail layer and then to multiply the detail layer by compression function for enhancing the detail information of the image. However, in most cases, an image displays the detail features and edge information of the objects in different scales. That is to say, all the detail features of the objects cannot be clearly reflected under a certain scale. The multi-scale decomposition utilizes more a scale extracts the edges and details of the image, the main idea is to filter the image through multi-scale decomposition to get a basic layer and several detail layers, which are respectively processed and synthesized at the output. In this paper, an GIF multi-scale decomposition for HDR image is introduced. The experimental results show that the proposed algorithm has better edge preserving performance than the conventional algorithm.

In this paper, we propose an algorithm that improves the weight map part consisting of signal strength, signal structure, and mean intensity. The patch-based conventional weight map causes the brightness of the image to be shifted to one side, resulting in loss of image information, unexpected artifacts, and an overall unbalance in image brightness. In this study, we propose a novel algorithm by improving the weight map. First, the order-statistic filter using maximum values. Second, the unsharp masking filter using Laplacian. Third, the linear combination using gamma transformation. The proposed algorithm prevents the loss of image information by reducing the over-saturation of the image, accurate representation of dark and bright areas by increasing contrast, and preserve the detail such as the edge. Through subjective and objective experimental results, it is confirmed that the proposed algorithm shows better performance than the conventional algorithms.

This paper presents a novel multidirectional weighted interpolation algorithm for color filter array interpolation. Our proposed method has two contributions to demosaicking. First, different from conventional interpolation methods based on two directions or four directions, the proposed method exploits to greater degree correlations among neighboring pixels along eight directions to improve the interpolation performance. Second, we propose an efficient postprocessing method to reduce interpolation artifacts based on the color difference planes. Compared with conventional state-of-the-art demosaicking algorithms, our experimental results show the proposed algorithm provides superior performance in both objective and subjective image quality. Furthermore, this implementation has moderate computational complexity.

This paper presents a piecewise image denoising with multi-scale block region detector based on quadtree structure for effective image restoration. Proposed piecewise image denoising method suggests multi-scale block region detector (MBRD) by dividing whole pixels of a noisy image into three parts, with regional characteristics: strong variation region, weak variation region, and flat region. These regions are classified according to total pixels variation between multi-scale blocks and are applied principal component analysis with local pixel grouping, bilateral filtering, and structure-preserving image decomposition operator called relative total variation. The performance of proposed method is evaluated by Experimental results. we can observe that region detection results generated by the detector seems to be well classified along the characteristics of regions. In addition, the piecewise image denoising provides the positive gain with regard to PSNR performance. In the visual evaluation, details and edges are preserved efficiently over the each region; therefore, the proposed method effectively reduces the noise and it proves that it improves the performance of denoising by the restoration process according to the region characteristics.

We propose an adaptive spatial postprocessing algorithm for using in block-based discrete cosine transform (BDCT) coded images. The proposed method is comprised of three procedural steps: a thresholding step, a model classification step, and a deblocking filtering step. First, we apply adaptive thresholding to extract the pixel vector containing the blocking artifacts. This threshold has a strong correlation with image quality and the standard deviation of the pixel vector. Next, we update block types using a simple rule, thus influencing deblocking performance. Our research proposes that the activity of the pixel vector can be used to categorize the pixel vector model. With the pixel vector model determined, we are then able to apply a suitable filter to each model with different local properties. For example, we are able to utilize a directional filter to reduce ringing artifacts in edge regions. With various images and bit-rate conditions, images deblocked by the proposed method exhibit both significant visual quality improvement and PSNR gain, with fairly low computational complexity.

In this paper, Enhanced binary block matching method for Constrained one-bit transform (C1BT) based motion estimation is proposed. Binary motion estimation exploits the Number of non-matched points (NNMP) as a block matching criterion instead of the Sum of Absolute Differences (SAD) for low complex motion estimation. The motion estimation using SAD could use the smaller block for more accurate motion estimation. In this paper the enhanced binary block matching method using smaller motion estimation block for C1BT is proposed to the more accurate binary matching. Experimental results shows that the proposed algorithm has better Peak Signal to Noise Ration PSNR) results compared with conventional binary transform algorithms. Keyword : Motion estimation, Block matching algorithm, One-bit transform, Constrained one-bit transform, Binary block

In this paper, a deep convolutional neural network (CNN) is used to remove speckle noise from synthetic aperture radar (SAR) images. However, only applying CNN to remove noise causes an under-fitting problem. To overcome this issue, we suggest to use stationary wavelet transform (SWT) to the images as a pre-processing. Afterward, the resultant sub-band images are utilized to construct the similar sub-band images to the original images by training the CNNs. The training process is carried out by considering a large multi-temporal SAR image and its multi-look version. In the experiment result of this paper, the proposed method showed better performance compared to other denoising algorithms in regard to PSNR and SSIM.

Ultrasound imaging devices are more secure and real-time than other medical diagnosis devices such as X-ray, CT, and MRI. However, due to speckle noise, it exhibits lower resolution and image quality than other than medical diagnostic devices. Therefore, it is difficult to diagnose lesions using ultrasound images due to this noise. In this paper, we propose an algorithm using speckle reducing anisotropic diffusion (SRAD) and a guided filter for speckle noise reduction and edge preservation. First, speckle, which is multiplicative noise, is removed by using SRAD. The remaining noise in the filtered image is converted to additive noise using logarithmic transformation. The additional noise remaining in the filtered image is further removed using a guided filter. Finally, the noise-free image obtained using exponential transform. Experimental results show that the proposed algorithm exhibits an excellent speckle noise reduction and edge preservation performance than the conventional filtering techniques.

This paper presents a maximum a posteriori (MAP) based intra-field deinterlacing algorithm. In the proposed algorithm, we propose a hybrid approach composed by point-wise and patch-wise measurements. The estimation of the missing pixel is formulated as an MAP and minimizing the energy function. By utilizing Bayes theory and some prior knowledge, the missing pixel is estimated with a statistical-based approach and we model the residual of the images as Gaussian and Laplacian distribution. Under the MAP framework, the desired deinterlaced image corresponds to the optimal reconstruction given the interlaced low resolution image. Compared with existing deinterlacing algorithms, the proposed algorithm improves peak signal-to-noise-ratio and the structural similarity while maintaining high efficiency.

In this paper, we propose a method for improved the non-local mean denoising algorithm by using the similarity in comparison with reference pixels. The noise in image is eliminated by the calculation to follow values as the patterns are similar in non-local mean denoising alogirthm. In the conventional algorithm, all the comparison results of the pixels are included in the denoising process, and even the low similarity result is included. The method causes the denoised effect to incorrect. In this paper, we propose an algorithm that reduces the influence of low-similarity reference pixels or improves the effect of high-similarity reference pixels. The proposed method improves both the object quality and the subject quality.

Demosaicking is an important step in generating a full-color image from a color filter array image captured by a single-sensor digital camera. In this paper, we propose a new demosaicking algorithm which uses Taylor series and an adaptive fusion strategy. For generating directional predictors, we present a new interpolator based on Taylor series. The directional predictors are used together with spatial and spectral correlations. Using these predictors and the adaptive fusion strategy improves the green channel interpolation, in turn helping to reconstruct the red and blue channel interpolations. Experiments comparing the proposed algorithm to some other demosaicking algorithms show that the proposed algorithm provides superior performance in terms of both objective and subjective image quality.

This paper presents a new demosaicking algorithm which uses two cost terms: the interpolation error of a low resolution image based on geometric duality and the dilated directional differentiation of color differences. Since a given high resolution image and its low resolution image obtained by sampling have similar edge properties, the proposed algorithm computes the interpolation errors for the candidate directions in the low resolution image, and exploits them as a cost term for the direction. In addition, the interpolation direction can be determined accurately even in the vicinity of object boundaries by dilating the directional differentiation of the color difference values. Through dilation, some pixels, which are in the neighborhood of an edge but classified into a flat region by simple edge detection like the Sobel filter, are reclassified. By combining this edge classifier and the weighted sum of the estimates obtained by Taylor approximation, missing pixels are interpolated. Simulation results show that the proposed demosaicking algorithm is superior to other state-of-the-art algorithms in terms of visual and objective qualities. Furthermore, the computational complexity is comparable with the existing algorithms. Therefore, the proposed algorithm is suitable for real-time implementation.

In this paper, we present a novel color image demosaicking algorithm. The algorithm consists of two steps: an interpolation step and a refinement step. The missing green color information is first interpolated by using the color channel difference. In the refinement step, a local weighted directional interpolation method guided by the pre-interpolated green channel is applied to refine the interpolation results along the determined interpolation direction. Lastly, post-processing is implemented to output the final demosaicked full color image. Due to well estimating the interpolation directions based on reliable inter-channel correlation, the interpolation accuracy is guaranteed, besides, an effective post-processing was implemented to reduce the interpolation artifacts. As a result, compared with the latest demosaicking algorithms, experiments showed that the proposed method provides superior performance in terms of both objective and subjective image qualities.

To generate a high resolution image from a low resolution one, interpolation plays a crucial role. However, conventional interpolation methods including edge-based interpolation methods have some drawbacks such as the limited number of edge directions, imprecise edge detection, and inefficient interpolation. To overcome these shortcomings, we propose a new edge-directed interpolation method, which has three aims: various edge directions, reliable edge detection, and outstanding interpolation. Since the number of candidate edge directions in the proposed method is flexible, we can use several edges included in the high resolution image. To accurately determine the edge direction, we use autocorrelation of neighboring pixels for candidate directions based on the duality between a high resolution image and its corresponding low resolution image. For the interpolation step, we utilize a Blackman–Harris windowed-sinc weighted average filter where we use correlation values obtained in the edge detection step as weights. Experimental results show that the proposed method outperforms conventional methods in terms of both the subjective and the objective results.

In this paper, we present a novel color image demosaicking algorithm based on a directional weighted interpolation method and gradient inverse-weighted filter-based refinement method. By applying a directional weighted interpolation method, the missing center pixel is interpolated, and then using the nearest neighboring pixels of the pre-interpolated pixel within the same color channel, the accuracy of interpolation is refined using a five-point gradient inverse weighted filtering method we proposed. The refined interpolated pixel values can be used to estimate the other missing pixel values successively according to the correlation inter-channels. Experimental analysis of images revealed that our proposed algorithm provided superior performance in terms of both objective and subjective image quality compared to conventional state-of-the-art demosaicking algorithms. Our implementation has very low complexity and is therefore well suited for real-time applications.

In this paper, we present a new depth upsampler in which an upsampled depth map is computed at each pixel as the average of neighboring pixels, weighted by color and depth intensity filters. The proposed method features two parameters, an adaptive smoothing parameter and a control parameter. The adaptive smoothing parameter is determined based on the ratio between a depth map and its corresponding color image. The adaptive smoothing parameter is used to control the dynamic range of the color-range filter. The control parameter assigns a larger weighting factor to pixels in the object to which a missing pixel belongs. In a comparison with five existing upsamplers, the proposed method outperforms all five in terms of both objective and subjective quality.

Synthetic aperture radar (SAR) images map Earth’s surface at high resolution, regardless of the weather conditions or sunshine phenomena. Therefore, SAR images have applications in various fields. Speckle noise, which has the characteristic of multiplicative noise, degrades the image quality of SAR images, which causes information loss. This study proposes a speckle noise reduction algorithm while using the speckle reducing anisotropic diffusion (SRAD) filter, discrete wavelet transform (DWT), soft threshold, improved guided filter (IGF), and guided filter (GF), with the aim of removing speckle noise. First, the SRAD filter is applied to the SAR images, and a logarithmic transform is used to convert multiplicative noise in the resulting SRAD image into additive noise. A two-level DWT is used to divide the resulting SRAD image into one low-frequency and six high-frequency sub-band images. To remove the additive noise and preserve edge information, horizontal and vertical sub-band images employ the soft threshold; the diagonal sub-band images employ the IGF; while, the low- frequency sub-band image removes additive noise using the GF. The experiments used both standard and real SAR images. The experimental results reveal that the proposed method, in comparison to state-of-the art methods, obtains excellent speckle noise removal, while preserving the edges and maintaining low computational complexity.

A transparent thin-film transistor-diode (TFT-diode) circuit through the serial connection of a transparent TFT and a transparent graphene diode comprised of an amorphous indium-gallium-zinc-oxide (a-IGZO) active layer and a graphene electrode are demonstrated. Through transferring the graphene electrode onto the fabricated TFT, the TFT operates in a single direction due to the directional operation of the transparent graphene diode. The resulting transparent TFT-diode device can be applied to transparent a-IGZO and graphene integrated circuits.

A new bilateral frame rate upconversion algorithm using the image texture complexity characteristic is proposed. In the proposed algorithm, as the cost function is adjusted according to the image texture complexity, the accuracy of motion estimation (ME) is improved. In the experimental results, the proposed algorithm outperforms the conventional bilateral ME process by 0.32 dB.