Search

Effective parsing of video through the spatial and temporal domains is vital to many computer vision problems because it is helpful to automatically label objects in video instead of manual fashion, which is tedious. Some literatures propose to parse the semantic information on individual 2D images or individual video frames, however, these approaches only take use of the spatial information, ignore the temporal continuity information and fail to consider the relevance of frames. On the other hand, some approaches which only consider the spatial information attempt to propagate labels in the temporal domain for parsing the semantic information of the whole video, yet the non-injective and non-surjective natures can cause the black hole effect. In this paper, inspirited by some annotated image datasets (e.g., Stanford Background Dataset, LabelMe, and SIFT-FLOW), we propose to transfer or propagate such labels from images to videos. The proposed approach consists of three main stages: I) the posterior category probability density function (PDF) is learned by an algorithm which combines frame relevance and label propagation from images. II) the prior contextual constraint PDF on the map of pixel categories through whole video is learned by the Markov Random Fields (MRF). III) finally, based on both learned PDFs, the final parsing results are yielded up to the maximum a posterior (MAP) process which is computed via a very efficient graph-cut based integer optimization algorithm. The experiments show that the black hole effect can be effectively handled by the proposed approach. [ABSTRACT FROM AUTHOR]

Abstract: Image segmentation is a fundamental problem in computer vision and image analysis. Specially, the segmentation of medical images can assist doctors in making decisions. Due to the lack of distinctive features to describe the boundary of an organ and match function with high performance for features, medical image segmentation is difficult to be achieved with high accuracy. In this paper, an one-class classifier is proposed as the match function to decide whether the pixel belongs to the boundary or not. The proposed method is comprised of two steps. At first, a feature vector space is built with the gradient feature and its statistical information in the training stage. In the test image, a feature vector of one candidate probably being located on the boundary is reconstructed by sparse coding with the feature vector space. After reconstruction, the candidate is classified belonging to boundary or non-boundary via the reconstruction based one-class classifier. Then, in order to maintain the consistency between the candidates which are neighbors to each other, the neighboring candidates are coded using group lasso with the same dictionary. Compared to the traditional methods, the proposed one has three advantages. Firstly, it solves the non-Gaussian distribution problem of the positive samples. Secondly, it avoids large variation among the negative samples. Thirdly, the relationship of the neighboring candidates is considered and used in classification, which is ignored in other methods. The proposed method is validated on 52 MR images of prostate and outperforms Mahalanobis distance, which is considered as one of the state-of-the-art match functions. The experimental results show that the segmentation accuracy can be significantly improved by the proposed method with one-class classification. [Copyright &y& Elsevier]

Assessing aesthetic appeal of images is a highly subjective task which has attracted a lot of interests recently. It is an interdisciplinary subject related to art, psychology, and computer vision. In this paper, we systematically study prior researches of feature extraction in this area, and category them into four groups, low level, rule based, information theory, and visual attention. In each group, the effectiveness and limitations of existing features are examined. Based on the analysis, we propose a comprehensive feature set, which include 16 novel features and 70 well proved features. With this feature set, we build the system under machine learning scheme consisting of an SVM based classifier to estimate if an image is high aesthetic or low aesthetic . The experiments are conducted on public datasets show that our comprehensive feature set outperforms conventional models that concentrate mainly on certain types of features. The combination of our features produces a promising classification accuracy of 82.4% and a good performance comparable to aesthetic rating of human. Finally, we implemented the proposed evaluation system on mobile devices. It can provide real-time feedback to help users capture appealing photos. [ABSTRACT FROM AUTHOR]