Search

Recent advance on highly realistic AI‐synthesised video approaches makes it hard to distinguish whether a speaker in video is real. Many existing DeepFakes detection approaches can be invalidated by using them as supervision in adversarial training, which in turn improves the performance of DeepFakes. This makes the problem a dilemma. However, human can recognise the identity of familiar persons by observing their motion styles. Inspired by this, the paper proposes a novel method to recognise original speaker's identity clues in DeepFakes videos by learning individual motion styles. As a biological signature, motion styles can neither be used in the training process of DeepFakes nor be modified to deceive detection methods without reducing realistic performance. Also, this paper proposes a novel pipeline to continuously restore the original frames from DeepFakes videos without knowing the DeepFakes approach in advance. Based on above ideas, our scheme makes it possible to restore DeepFakes videos. Through training the cross‐modal transfer module, the appearance embedding can be inferred from the identity code. Extensive experiments are conducted to reveal the effectiveness of the method, it shows for the first time that the original persons can be identified automatically and the original video from DeepFakes videos can be generated. [ABSTRACT FROM AUTHOR]

Vector quantisation (VQ) shows a good performance for image coding with high‐compression ratios. However, there are many difficulties for image coding with VQ, especially the edge degradation and high‐computational complexity. To resolve these two problems, the authors propose a new coding method based on edge orientation patterns (EOPs) by classifying image blocks into nine classes according to their edge orientations. For colour image coding, 27 codebooks (nine for each colour component) are pre‐designed based on a series training images. In the encoding stage, an input colour image is decomposed into Y, Cb, and Cr components, and each component image is divided into non‐overlapping 4 × 4 blocks. For each block, eight edge orientation templates of size 4 × 4 are performed to determine its edge orientation. According to the edge orientation, each block is compressed by using the corresponding codebook. Essentially, the authors' scheme is a kind of classified VC (CVQ). Simulation results show that, their EOP‐based CVQ can largely improve the compression efficiency as well as speeding up the encoding process and it is sufficient to establish effectiveness of the authors' algorithm as compared with the existing techniques. [ABSTRACT FROM AUTHOR]

Recent advances in convolutional neural networks have achieved prominent results for object counting or locating in images. In these networks, some adopt detection‐based methods which require providing bounding‐box annotations for training and these methods usually cannot deal with the crowded cases well. Other networks adopt density regression‐based methods which require only point annotations for training but these methods can only predict the total count without providing any location information. In this Letter, the authors propose an attention guided convolutional neural network (AGNet) for both crowded object locating and counting using point annotation as supervision without annotated bounding boxes which are far more time‐consuming to label. Accordingly, they define a multi‐task objective loss function to lead the training of AGNet to achieve the goal of crowded object locating. The experimental results on four challenging benchmark datasets for crowded objects counting demonstrate the superiority of the proposed AGNet over recent state‐of‐the‐art approaches. [ABSTRACT FROM AUTHOR]

A new feature for image retrieval based on edge orientation patterns (EOPs) by classifying image blocks into nine classes according to their EOs. Each input colour image is decomposed into Y, Cb and Cr components, and each component image is divided into non‐overlapping 4 × 4 blocks. For each block, eight EO templates of size 4 × 4 are performed to determine its EO. On the other hand, vector quantisation (VQ) is an efficient clustering and classification technique for high‐dimensional spaces, and thus VQ is also used to extract the texture features. The retrieval simulation results show that the EOP‐histogram‐based features combined with the traditional VQ‐index‐histogram‐based features can largely improve the recall and precision performance. [ABSTRACT FROM AUTHOR]