235 results
Search Results
2. Multivariate time series anomaly detection via separation, decomposition, and dual transformer-based autoencoder.
- Author
-
Fu, Shiyuan, Gao, Xin, Li, Baofeng, Zhai, Feng, Lu, Jiansheng, Xue, Bing, Yu, Jiahao, and Xiao, Chun
- Subjects
LATENT variables ,BINARY codes ,TIME series analysis - Abstract
Multivariate time series usually have entangled temporal patterns and various anomaly types. Meanwhile, they often contain both continuous and discrete features. Many existing methods directly model correlations in complex multivariate time series to conduct anomaly detection. Decomposing time series into different components, such as the overall trend and fluctuations, can contribute to better extracting semantic information and detecting anomalies. Existing decomposition-based anomaly detection methods still have several limitations. First, they directly decompose all features without considering that discrete features are unsuitable for decomposition because they do not have trends or fluctuations. Second, they adopt the same networks for different components with different characteristics, limiting their ability to extract semantic information. Moreover, due to the nature of Transformers, existing reconstruction-based methods using Transformers rarely form information bottlenecks, reducing the differentiation between the reconstruction errors of normal data and anomalies. This paper proposes a multivariate time series anomaly detection method with separation, decomposition, and dual Transformer-based autoencoder (SDDformer). Different from existing methods, SDDformer separates continuous and discrete features and only decomposes continuous features into trend and residual components. Considering the different characteristics of different components, SDDformer adopts Crossformer and the vanilla Transformer as the backbone of two different autoencoders to reconstruct the trend and residual components. Information bottlenecks are better formed using an extra token as the latent variable between the encoder and the decoder. SDDformer regards reconstructing a discrete feature as a classification task and calculates Cross-Entropy as its reconstruction error. Three different metrics are adopted in this paper to compare SDDformer with a variety of typical anomaly detection methods on public data sets, and the experimental results prove that SDDformer can achieve state-of-the-art performance. • A two-stream multivariate time series anomaly detection method is proposed. • Continuous and discrete features are separated before decomposition. • Only continuous features are decomposed into the trend and residual components. • Two different autoencoders are proposed to reconstruct different components. • The reconstruction of a discrete feature is regarded as a classification task. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
3. Avoiding right angles and certain Hamming distances.
- Author
-
Bursics, Balázs, Matolcsi, Dávid, Pach, Péter Pál, and Schrettner, Jakab
- Subjects
- *
BINARY codes , *ANGLES , *HAMMING distance - Abstract
In this paper we show that the largest possible size of a subset of F q n avoiding right angles, that is, distinct vectors x , y , z such that x − z and y − z are perpendicular to each other is at most O (n q − 2). This improves on the previously best known bound due to Naslund [13] and refutes a conjecture of Ge and Shangguan [11]. A lower bound of n q / 3 is also presented. It is also shown that a subset of F q n avoiding triangles with all right angles can have size at most O (n 2 q − 2). Furthermore, asymptotically tight bounds are given for the largest possible size of a subset A ⊆ F q n for which x − y is not self-orthogonal for any distinct x , y ∈ A. The exact answer is determined for q = 3 and n ≡ 2 (mod 3). Our methods can also be used to bound the maximum possible size of a binary code where no two codewords have Hamming distance divisible by a fixed prime q. Our lower- and upper bounds are asymptotically tight and both are sharp in infinitely many cases. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
4. MGML: Momentum group meta-learning for few-shot image classification.
- Author
-
Zhu, Xiaomeng and Li, Shuxiao
- Subjects
- *
BINARY codes , *PROBLEM solving , *CLASSIFICATION , *RANDOM matrices , *TRANSFER matrix - Abstract
• GML (Group Meta-Learning) is proposed to effectively alleviate the problem that low-quality samples have unfavourable impact on the training effect under few-shot conditions, thereby improving the performance of the model. • Momentum update strategy is introduced to few-shot learning for the first time to effectively improve the generalization and stability of the model, and an adaptive momentum coefficient is designed to form AMS (Adaptive Momentum Smoothing) to further improve the training efficiency. • We propose MGML (Momentum Group Meta-Learning) by combining GML and AMS. MGML not only improves the accuracy of Meta-Learning Baseline, but also has good mobility. It can be inserted into previous state-of-the-art methods and get consistent performance improvements. At present, image classification covers more and more fields, and it is often difficult to obtain enough data for learning in some specific scenarios, such as medical fields, personalized customization of robots, etc. Few-shot image classification aims to quickly learn new classes of features from few images, and the meta-learning method has become the mainstream due to its good performance. However, the generalization ability of the meta-learning method is still poor and easy to be disturbed by low-quality images. In order to solve the above problems, this paper proposes Momentum Group Meta-Learning (MGML) to achieve a better effect of few-shot learning, which contains Group Meta-Learning module (GML) and Adaptive Momentum Smoothing module (AMS). GML obtains an ensemble model by training multiple episodes in parallel and then grouping them, which can reduce the interference of low-quality samples and improve the stability of meta-learning training. AMS includes the adaptive momentum update rule to further optimally integrate models between different groups, so that the model can memorize experience in more scenarios and enhance the generalization ability. We conduct experiments on miniImageNet and tieredImageNet datasets. The results show that MGML improves the accuracy, stability and cross-domain transfer ability of few-shot image classification, and can be applied to different few-shot learning models. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
5. Graph parameters, implicit representations and factorial properties.
- Author
-
Alecu, B., Alekseev, V.E., Atminas, A., Lozin, V., and Zamaraev, V.
- Subjects
- *
COMPUTER storage devices , *BINARY codes , *FACTORIALS - Abstract
How to efficiently represent a graph in computer memory is a fundamental data structuring question. In the present paper, we address this question from a combinatorial point of view. A representation of an n -vertex graph G is called implicit if it assigns to each vertex of G a binary code of length O (log n) so that the adjacency of two vertices is a function of their codes. A necessary condition for a hereditary class X of graphs to admit an implicit representation is that X has at most factorial speed of growth. This condition, however, is not sufficient, as was recently shown in [19]. Several sufficient conditions for the existence of implicit representations deal with boundedness of some parameters, such as degeneracy or clique-width. In the present paper, we analyze more graph parameters and prove a number of new results related to implicit representation and factorial properties. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
6. Binary multi-modal matrix factorization for fast item cold-start recommendation.
- Author
-
Peng, Chengmei, Zhu, Lei, Xu, Yang, Li, Yaping, and Guo, Lei
- Subjects
- *
MATRIX decomposition , *BINARY codes , *HAMMING distance , *SOURCE code , *USER-generated content - Abstract
Hashing technology can support large-scale recommendation very effectively due to its advantages of low storage cost and high recommendation efficiency. However, existing hashing-based recommendation methods often suffer from item cold-start problem. This is because they simply consider the user-item interaction and the single content information of the items, but the full interaction history is not always available and the single auxiliary information may be missing. To solve this issue, in this paper we propose a Binary Multi-modal Matrix Factorization (BMMF) method. First, we propose an efficient consensus multi-modal mapping to transform the heterogeneous multi-modal features to the unified factors by exploiting the complementarity of multiple modalities. Then, binary matrix factorization is simultaneously performed on the multi-modal features of the items and past user preferences to learn the compact binary codes of the users/items in a common Hamming space. In addition, inspired by the observation that similar instances often have similar binary codes within a short Hamming distance, we formulate a semantic structure regularization term to preserve the similarities of the items during the binary embedding process. Finally, we develop an effective Discrete Coordinate Descent (DCD) approach to tackle the formulated discrete hash optimization problem directly. Experiments on three publicly available real-world datasets demonstrate the superiority of the proposed method against the state-of-the-art methods. Our source codes and testing datasets are available at https://github.com/pcm1217/BMMF. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
7. On the decomposition of circulant graphs using algorithmic approaches.
- Author
-
El-Mesady, A., Hamed, Y.S., and Shabana, H.
- Subjects
GRAPH theory ,ORTHOGONAL decompositions ,COMPLETE graphs ,COMPUTER algorithms ,BINARY codes ,GRAPH algorithms ,BIPARTITE graphs - Abstract
Many structural models in chemistry, biology, computer science, sociology, and operations research can be analyzed using graph theory. Some examples of these structure models are species movement between regions, molecular bonds, shortest spanning trees, development of computer algorithms. This paper introduces the edge decomposition of circulant graphs with 2 n vertices by different graph classes. These circulant graphs are denoted as C 2 n , n , where n is the degree of the graph C 2 n , n. We propose two algorithmic approaches for constructing edge decomposition of C 2 n , n. With aid of the proposed algorithmic approaches, we construct paths decompositions, trees decompositions, disjoint unions of cycles and trees decompositions, and complete bipartite graphs decompositions of C 2 n , n. In the end, a recursive construction of an edge decomposition, based on orthogonal edge decompositions, is proposed. This helps in using the mutually orthogonal decompositions of the circulant graphs C 2 n , n in several applications, such as the design of experiments and binary codes generation. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
8. Random projection and hashing based privacy preserving for image retrieval paradigm using invariant and clustered feature.
- Author
-
Majhi, Mukul and Mallick, Ajay Kumar
- Subjects
IMAGE retrieval ,BINARY codes ,IMAGE encryption ,CONTENT-based image retrieval ,FEATURE extraction - Abstract
In recent years, exploration of local characteristics have been an effective feature extraction technique for managing multimedia repository for image retrieval. These class of approaches accelerate the image retrieval. However, with the increase of online intrusion, it is also essential to provide confidentiality for the private online data with effective functionality and significant retrieval accuracy. In this paper, we have solved the protuberant bottleneck problem of privacy-preserving in CBIR using random projection technique for feature encryption with effective retrieval. For this, we formulated highly discriminative interest points based features that are rotation and translation invariant and are constructed using k -means clustering and silhouette concept. Moreover, we have devised locally likely arrangement hashing technique that can incorporate fast, accurate, and secure matching over encrypted features. Based on the experiment, it substantially outperforms the recent state-of-the-art techniques in terms of retrieval accuracy and time overhead on various standard benchmarks, namely, Corel, Olivia, ALOI, and MPEG-7. The proposed method on average provided retrieval accuracy of 83.10%, 81.30%, 81.62%, 73.01% for Corel, Olivia, ALOI and MPEG-7 plaintexted feature, respectively while retrieval accuracy of 79.90% for Corel, 79.10% for Olivia, 79.97% for ALOI, and 67.34% for MPEG-7 using the encrypted feature. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
9. Improved results for T-S fuzzy systems with two additive time-varying delays via an extended binary quadratic function negative-determination lemma.
- Author
-
Liu, Yapeng, Zhou, Kun, Zhong, Shouming, Shi, Kaibo, and Li, Xuezhi
- Subjects
- *
FUZZY systems , *DERIVATIVES (Mathematics) , *ADDITIVES , *TIME-varying systems , *BINARY codes - Abstract
This paper is concerned with the stability and stabilization problems for T-S fuzzy systems with two additive time-varying delays. Firstly, a novel Lyapounov-Krasovskii functional (LKF) is constructed by delay-product-type functional method together with the state vector augmentation. In order to handle time-delay square terms introduced into the derivative of LKF, an extended binary quadratic function negative-determination lemma is proposed. A less conservative delay-dependent stability condition is developed since not only some new bounding technologies are employed to deal with integral terms, but also the proposed lemma is employed to dispose nonlinear time-delay terms in derivative of constructed function. Then, the corresponding controller design method for closed-loop delayed fuzzy system is derived based on parallel distributed compensation scheme. Finally, four numerical examples are given to illustrate the superiority and effectiveness of the proposed criteria. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
10. On the computation of Seidel Laplacian eigenvalues for graph-based binary codes.
- Author
-
Mesnager, Sihem, Raja, Rameez, and Wagay, Samir Ahmad
- Subjects
- *
BINARY codes , *EIGENVALUES , *DIVISOR theory , *POLYNOMIAL rings , *REGULAR graphs , *INTEGERS - Abstract
Let G = (V , E) be a simple graph with vertex set as V and edge set as E. Within the framework of graph-based binary coding, a graph G is a threshold graph if and only if it can be generated by a binary code of the type 0 s 1 1 t 1 ... 0 s k 1 t k , where s i and t i are positive integers with 1 ≤ i ≤ k. This type of binary code is called a binary generating code of G. In this paper, we address a problem originally posed by Harary and Schwenk in [10] titled "Which graphs have integral spectra?" in which the main focus of our investigations lies in the Seidel Laplacian spectrum of G generated by 0 s 1 1 t 1 ... 0 s k 1 t k . We establish that all eigenvalues of G are integers and multiplicities of eigenvalues are equal to powers of bits 0 and 1 (sizes of strings of 0's and 1's) involved in a binary generating code of G. We exhibit a necessary and sufficient condition in terms of eigenvalues of the matrix associated with a graph-based G binary code to be Seidel Laplacian integral. Furthermore, for any prime p , we explore the Seidel Laplacian spectrum of zero-divisor graphs associated with the ring Z p m (where m is a positive integer) and the polynomial ring Z p [ x ] / (x p). [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
11. Flipping-based iterative surface reconstruction for unoriented points.
- Author
-
Ma, Yueji, Meng, Yanzun, Xiao, Dong, Shi, Zuoqiang, and Wang, Bin
- Subjects
- *
SURFACE reconstruction , *NONLINEAR equations , *COMPUTATIONAL complexity , *INTEGER programming , *NONLINEAR systems , *BINARY codes - Abstract
In this paper, we propose a novel surface reconstruction method for unoriented points by establishing and solving a nonlinear equation system. By treating normals as unknown parameters and imposing the conditions that the implicit field is constant and its gradients parallel to the normals on the input point cloud, we establish a nonlinear equation system involving the oriented normals. To simplify the system, we transform it into a 0-1 integer programming problem solely focusing on orientation by incorporating inconsistent oriented normal information through PCA. We solve the simplified problem using flipping-based iterative algorithms and propose two novel criteria for flipping based on theoretical analysis. Extensive experiments on renowned datasets demonstrate that our flipping-based method with wavelet surface reconstruction achieves state-of-the-art results in orientation and reconstruction. Furthermore, it exhibits linear computational and storage complexity by leveraging the orthogonality and compact support properties of wavelet bases. The source code is available at https://github.com/mayueji/FISR_code. • We propose a novel surface reconstruction method by establishing and solving nonlinear equation systems numerically. • To tackle the nonlinear equation system, we innovatively propose the gradient-based criterion and value-based criterion. • Our method achieves state-of-the-art performance in orientation and reconstruction. Its linear complexity overcomes computational and storage bottlenecks. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
12. Structure-aware contrastive hashing for unsupervised cross-modal retrieval.
- Author
-
Cui, Jinrong, He, Zhipeng, Huang, Qiong, Fu, Yulu, Li, Yuting, and Wen, Jie
- Subjects
- *
BINARY codes - Abstract
Cross-modal hashing has attracted a lot of attention and achieved remarkable success in large-scale cross-media similarity retrieval applications because of its superior computational efficiency and low storage overhead. However, constructing similarity relationship among samples in cross-modal unsupervised hashing is challenging because of the lack of manual annotation. Most existing unsupervised methods directly use the representations extracted from the backbone of their respective modality to construct instance similarity matrices, leading to inaccurate similarity matrices and resulting in suboptimal hash codes. To address this issue, a novel unsupervised hashing model, named Structure-aware Contrastive Hashing for Unsupervised Cross-modal Retrieval (SACH), is proposed in this paper. Specifically, we concurrently employ both high-dimensional representations and discriminative representations learned by the network to construct a more informative semantic correlative matrix across modalities. Moreover, we design a multimodal structure-aware alignment network to minimize heterogeneous gap in the high-order semantic space of each modality, effectively reducing disparities within heterogeneous data sources and enhancing the consistency of semantic information across modalities. Extensive experimental results on two widely utilized datasets demonstrate the superiority of our proposed SACH method in cross-modal retrieval tasks over existing state-of-the-art methods. • We propose an informative multimodal correlation matrix construction approach. • We propose a multimodal structure-aware alignment network to bridge heterogeneous gaps. • Extensive experiments show SACH's superiority in cross-modal retrieval. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
13. GTPAN: Global Target Preference Attention Network for session-based recommendation.
- Author
-
Lu, Tingwei, Xiao, Xinyu, Xiao, Yin, and Wen, Junhao
- Subjects
- *
ATTENTION , *ACCESS to information , *BINARY codes , *MISSING data (Statistics) - Abstract
Session-based recommendations (SBR) aim to predict the user's next choice of items based on historical data. It is hard to access the interaction information between users and we can only analyze the user's behavioral preferences based on the current session characteristics, which makes the recommendation task in this field quite challenging. Recently, considerable research has grown up around the theme of SBR. Previous works apply attention mechanisms and Graph Neural Networks (GNN) to achieve remarkable results. However, these methods ignore two main points: one is losing sight of the specific position of items in the session; the other is to drive global preference with local preference without considering the offset of the target preference among items in the session. This paper proposes a Global Target Preference Attention Network (GTPAN) Model with position information for the session-based recommendation. We introduce a position-aware embedding module to eliminate the effect of position missing. Considering that each item in the session is potentially rich in latent information of target preference, we use a target preference attention layer to learn the target preference vector of the session. Extensive experiments on three real datasets show that the proposed GTPAN model outperforms state-of-the-art session-based recommendation methods, especially on datasets with long sessions. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
14. Gaussian similarity preserving for cross-modal hashing.
- Author
-
Lin, Liuyin and Shu, Xin
- Subjects
- *
SEQUENTIAL learning , *BINARY codes - Abstract
Cross-modal hashing (CMH) has gained considerable attention due to its low storage and fast query speed. Most existing CMH research pursues the binary codes of each modality by preserving a similarity matrix which is computationally expensive. In this paper, we propose a Gaussian similarity preserving method for cross-modal hashing. By using the semantic transformation, our model can avoid computing the similarity matrix explicitly. We further employ the sequential learning approach to reduce the quantization error. Experimental results on three benchmark datasets clearly show that our proposed method can outperform the state-of-the-art methods. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
15. Delving into the representation learning of deep hashing.
- Author
-
Cui, Quan, Chen, Zhao-Min, and Yoshie, Osamu
- Subjects
- *
BINARY codes , *VISUAL fields , *PROBLEM solving - Abstract
Searching for the nearest neighbor is a fundamental problem in the computer vision field, and deep hashing has become one of the most representative and widely used methods, which learns to generate compact binary codes for visual data. In this paper, we first delve into the representation learning of deep hashing and surprisingly find that deep hashing could be a double-edged sword, i.e. , deep hashing can accelerate the query speed and decrease the storage cost in the nearest neighbor search progress, but it greatly sacrifices the discriminability of deep representations especially with extremely short target code lengths. To solve this problem, we propose a two-step deep hashing learning framework. The first step focuses on learning deep discriminative representations with metric learning. Subsequently, the learning framework concentrates on simultaneously learning compact binary codes and preserving representations learned in the former step from being sacrificed. Extensive experiments on two general image datasets and four challenging image datasets validate the effectiveness of our proposed learning framework. Moreover, the side effect of deep hashing is successfully mitigated with our learning framework. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
16. A composite framework for photovoltaic day-ahead power prediction based on dual clustering of dynamic time warping distance and deep autoencoder.
- Author
-
Yang, Mao, Zhao, Meng, Huang, Dawei, and Su, Xin
- Subjects
- *
DISCRETE wavelet transforms , *CONVOLUTIONAL neural networks , *NUMERICAL weather forecasting , *BINARY codes - Abstract
The improvement of photovoltaic (PV) power prediction precision plays a crucial role in the new energy consumption. This paper proposes a composite prediction framework (DC (DWT-DAE)-CNN) consisting of dual clustering and convolutional neural network to achieve day-ahead prediction of PV power. To avoid the temporal uncertainty of PV power and the high-dimensional complexity of numerical weather prediction, the raw data are processed by Discrete Wavelet Transform (DWT) and Deep Autoencoder respectively (DAE) to reduce the data redundancy. Secondly, a dual clustering pattern based on dynamic time warping distance clustering and Fuzzy C-Mean (FCM) clustering is proposed to progressively realize the dynamic characteristics of the power curve and numerical clustering of the weather information data. Finally, the data from PV plants in northeast China are used for validation. The results show that the annual average day-ahead prediction AR of the DC (DWT-DAE)-CNN model can reach 90.17%, which is better than other competing models. In addition, the dual clustering pattern performs better than other traditional clustering patterns with the same predictor. Using this method to predict the PV output power can provide better theoretical guidance for the stable and safe operation of grid-connected PV. • A dual clustering model based on numerical variation and curve morphology variation is proposed. • The power data and NWP data were processed separately using Discrete Wavelet Transform and Deep Autoencoder. • Building multiple convolutional neural network predictors for PV power day-ahead prediction. • The proposed model was shown to outperform the comparison model under different seasons. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
17. A new algorithm of links labelling for the isomorphism detection of various kinematic chains using binary code.
- Author
-
Rai, Rajneesh Kumar and Punjabi, Sunil
- Subjects
- *
BINARY codes , *KINEMATIC chains , *ALGORITHMS , *LABELS - Abstract
Highlights • A new algorithm of links labelling along with the binary code, is used for the isomorphism detection of kinematic chains. • Kinematic chains with simple and multiple joints, and also the Epicyclic gear chains have been tested very effectively. • Decoding of the binary codes for various kinematic chains is presented in a unique way. Abstract Isomorphism of kinematic chains (KCs) has always been a critical issue for the researchers dealing with structural synthesis. Consequently, many researchers of repute presented various methods during the last eight decades for the KCs with either simple and/or multiple joints. Binary code is one of such various methods, but the major problem lies in the algorithm of links labelling, which becomes cumbersome, in particular, for large KCs. The paper presents a simple algorithm of links labelling used to find out a binary sequence which, in turn, provides a maximum binary code (chain invariant). The algorithm is tested for six, seven, eight, nine, ten, eleven, twelve and fifteen links with simple joints, seven and eight links KCs with multiple joints and finally, the Epicyclic gear trains (EGTs) with four, five and six links for its efficiency and reliability. The results are in full agreement with the references taken for the purpose. The paper discusses, in a unique way, the decoding of the binary codes of different KCs also. [ABSTRACT FROM AUTHOR]
- Published
- 2019
- Full Text
- View/download PDF
18. Characterization of runtime resource usage from analysis of binary executable programs.
- Author
-
de Souza Pinto, Renê, Botazzo Delbem, Alexandre Claudio, and Monaco, Francisco José
- Subjects
RUN time systems (Computer science) ,BINARY codes ,CODING theory ,BINARY sequences ,PHYLOGENY - Abstract
Graphical abstract Highlights • A method is proposed to characterize a computer program's runtime resource usage from the analysis of its binary executable file. • The approach produces a phylogeny (hierarchical clustering) of programs based on syntactic similarities found in the executable code. • Rationales are introduced to explain that these similarities in the binary file correlate to corresponding similarities in runtime behavior. • The placement of a program in the binary-code phylogeny bears resemblance to the relative similarity of its runtime behavior with respect to the other programs. • Experimental results show numerically significant evidences that the soft computing method is capable of characterizing runtime profile from binary-code similarities. Abstract This paper introduces a methodology for characterizing the runtime resource demands of a computer program from the analysis of its binary executable file. Categorization of applications according to the kind of resources required during execution – such as CPU and memory usage – is a sough-after piece of knowledge for the aims of computer system design and management. Conventional techniques available for this purpose include white-box static source code analysis and profile matching based on historical execution data. The former tends to be challenging in face of complex software architectures and requires access to the source code; the latter is dependent on the availability of reliable past data and on the selection of features yielding effective correlations with resource usage. The alternative data mining approach proposed in this paper avoids those difficulties by manipulating binary executable files. The method combines techniques from information theory, complex networks and phylogenetics to produce a hierarchical clustering of a set of executable files, which can be used to infer potential similarities in terms of runtime resource usage. The paper introduces the method's rationales and presents results of its application to characterize CPU and IO usages of benchmark applications executed on a standard PC platform. Essays carried out over a set of 80 programs from varying sources yielded numerically significant evidences that the prediction of resource usage similarity obtained by the approach is consistent with experimentally measured runtime profile. [ABSTRACT FROM AUTHOR]
- Published
- 2018
- Full Text
- View/download PDF
19. Robust supervised discrete hashing.
- Author
-
Xiao, Yao, Zhang, Wei, Dai, Xiangguang, Dai, Xiangqin, and Zhang, Nian
- Subjects
- *
BINARY codes , *MATRIX multiplications , *IMAGE retrieval - Abstract
In this paper, we proposed a more robust supervised hashing framework based on the Cauchy loss function and Supervised Discrete Hashing (SDH) called Robust Supervised Discrete Hashing (RSDH), which can learn a robust subspace consisted of binary codes. The Cauchy loss is used to measure the error between the label matrix and the product of the decomposed matrices. RSDH can not only reduce the outliers and noise of the hashing codes, but also achieve the more satisfactory retrieval effect. Image retrieval experiments demonstrate that RSDH performs better than the other hashing methods. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
20. HITS: Binarizing physiological time series with deep hashing neural network.
- Author
-
Fu, Zhaoji, Wang, Can, Wei, Guodong, Zhang, Wenrui, Du, Shaofu, and Hong, Shenda
- Subjects
- *
TIME series analysis , *BINARY codes , *CONVOLUTIONAL neural networks , *MULTISPECTRAL imaging - Abstract
• A deep neural network architecture is proposed to learn binary hash codes from physiological time series. • High utility, similarity preserving and temporal relationship are jointly learned with multiple designed objectives. • Experiments on ECG and EEG datasets show the effectiveness of the proposed method. In this paper, we aim to transform numerical physiological time series into binary hash codes, that can be further used for indexing large-scale dataset, or accelerating downstream tasks such as instance-based classification. We propose HITS to learn binary H ash codes from phys I ological T ime S eries. HITS first builds a very deep one-dimensional convolutional neural network to learn lower-dimensional representations from raw physiological time series. Then, HITS jointly learns high utility, similarity preserving, and temporal related compact binary codes by corresponding objectives with imposed. Finally, given a new physiological time series, HITS can encode it to a binary hash code. Experiments are performed on two real-world Electrocardiogram and Electroencephalogram datasets. The accuracy of a k-nearest classifier is used to evaluate the quality of codes. HITS outperforms the second-best baseline 7.42% on average of k = { 1 , 2 , 4 , 8 , 16 , 32 } with code length c = 48 , while reducing 45.51% searching time than the same length numerical vectors on average of c = { 16 , 24 , 32 , 48 , 64 }. HITS consistently achieve higher classification accuracy than compared methods using k-nearest classifier varying different k and code length. Thus, HITS learns better binary hash codes than compared methods. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
21. Hierarchical denoising representation disentanglement and dual-channel cross-modal-context interaction for multimodal sentiment analysis.
- Author
-
Li, Zuhe, Huang, Zhenwei, Pan, Yushan, Yu, Jun, Liu, Weihua, Chen, Haoran, Luo, Yiming, Wu, Di, and Wang, Hao
- Subjects
- *
SENTIMENT analysis , *USER-generated content , *BINARY codes - Abstract
Multimodal sentiment analysis aims to extract sentiment cues from various modalities, such as textual, acoustic, and visual data, and manipulate them to determine the inherent sentiment polarity in the data. Despite significant achievements in multimodal sentiment analysis, challenges persist in addressing noise features in modal representations, eliminating substantial gaps in sentiment information among modal representations, and exploring contextual information that expresses different sentiments between modalities. To tackle these challenges, our paper proposes a new Multimodal Sentiment Analysis (MSA) framework. Firstly, we introduce the Hierarchical Denoising Representation Disentanglement module (HDRD), which employs hierarchical disentanglement techniques. This ensures the extraction of both common and private sentiment information while eliminating interference noise from modal representations. Furthermore, to address the uneven distribution of sentiment information among modalities, our Inter-Modal Representation Enhancement module (IMRE) enhances non-textual representations by extracting sentiment information related to non-textual representations from textual representations. Next, we introduce a new interaction mechanism, the Dual-Channel Cross-Modal Context Interaction module (DCCMCI). This module not only mines correlated contextual sentiment information within modalities but also explores positive and negative correlation contextual sentiment information between modalities. We conducted extensive experiments on two benchmark datasets, MOSI and MOSEI, and the results indicate that our proposed method offers state-of-the-art approaches. • Multimodal sentiment analysis framework using hierarchical denoising representation disentanglement. • Hierarchical Denoising Representation Disentanglement (HDRD) Module to generate noise-free modal representations. • Dual-channel Cross-modal-context Interaction (DCCMCI) Module for intra-modal and inter-modal contextual interaction. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
22. Low complexity, high throughput, energy efficient, pipelined and reconfigurable ASIC realization architecture for multi-layer perceptron models.
- Author
-
Tripathi, Raghuvendra Pratap, Krishna, Virat, Tiwari, Manish, Trivedi, Gaurav, Dhawan, Amit, and Kumar, Prashant
- Subjects
- *
ARTIFICIAL neural networks , *BINARY codes , *PARALLEL processing , *ARITHMETIC , *SYMMETRY - Abstract
There has been continuously growing research interest in Artificial Neural Networks (ANNs) due to their vast acceptance in many real-world applications. This has led to the appearance of a variety of realization methods for multilayer perceptron (MLP) inference models. In this paper, we propose a generalized 3-stage, configurable, multiplier-less, massive parallel realization architecture for MLP inference models. We use offset binary coded distributive arithmetic (OBC-DA), which uses LUTs to reduce hardware requirements, to realize internal computing units of MLPs. The designing efforts to achieve a reduction in resource requirements are two-fold; (i) reduction in LUT size itself, which is achieved by exploiting symmetry induced by OBC-DA and thereby reducing LUT size by 50%, and (ii) reduction in total number of LUTs which is attained by sharing the LUTs. The resource efficiency of the proposed architecture is further improved by decomposing the LUTs into parallel and smaller LUTs. Moreover, the resource efficiency is also enhanced by utilizing the symmetry among the inputs in the MLP layer. The ASIC synthesis results for underlying MLPs establish that the proposed method for the realization of MLPs is much more efficient than the earlier reported methods and coincides with the findings of the generalized hardware-timing complexities. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
23. Imbalanced complemented subspace representation with adaptive weight learning.
- Author
-
Li, Yanting, Wang, Shuai, Jin, Junwei, Zhu, Fubao, Zhao, Liang, Liang, Jing, and Philip Chen, C.L.
- Subjects
- *
DATA mining , *LEARNING strategies , *SKEWNESS (Probability theory) , *BINARY codes - Abstract
Class imbalance problems pose significant challenges in the field of data mining. The skewed distribution of classes in imbalanced datasets often leads conventional classification methods to neglect the importance of minority classes, favoring the majority ones. In this paper, we propose an imbalanced complemented subspace representation model with adaptive weight learning to address imbalanced classification challenges. This approach incorporates a novel regularization technique and an adaptive weighting mechanism. The regularization technique integrates a complemented subspace term based on space theory into the efficient collaborative representation-based classification (CRC) framework, enhancing the overall accuracy of existing CRC-based methods. Furthermore, it takes into account both intra-class and inter-class density information to assign greater weights to minority classes. This highlights the contribution of minority classes and mitigates bias towards majority classes. Additionally, it is demonstrated that the proposed model can be efficiently solved with a closed-form solution. Extensive experiments conducted on diverse imbalanced datasets showcase the superiority of our method over most state-of-the-art imbalanced classification algorithms. • A complemented subspace regularization term is introduced into CRC. • An adaptive weight learning strategy is present. • The closed-form solution is provided to ensure the efficiency of our model. • Experimental results show the effectiveness of our method. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
24. Exploiting negative correlation for unsupervised anomaly detection in contaminated time series.
- Author
-
Lin, Xiaohui, Li, Zuoyong, Fan, Haoyi, Fu, Yanggeng, and Chen, Xinwei
- Subjects
- *
TIME series analysis , *GAUSSIAN distribution , *BINARY codes , *FOOD contamination - Abstract
Anomaly detection in time series data is crucial for many fields such as healthcare, meteorology, and industrial fault detection. However, traditional unsupervised time series anomaly detection methods suffer from biased anomaly measurement under contaminated training data. Most of existing methods employ hard strategies for contamination calibration by assigning pseudo-label to training data. These hard strategies rely on threshold selection and result in suboptimal performance. To address this problem, in this paper, we propose a novel unsupervised anomaly detection framework for contaminated time series (NegCo), which builds an effective soft contamination calibration strategy by exploiting the observed negative correlation between semantic representation and anomaly detection inherent within the autoencoder framework. We innovatively redefine anomaly detection in data contamination scenarios as an optimization problem rooted in this negative correlation. To model this negative correlation, we introduce a dual construct: morphological similarity captures semantic distinctions relevant to normality, while reconstruction consistency quantifies deviations indicative of anomalies. Firstly, the morphological similarity is effectively measured based on the representative normal samples generated from the center of the learned Gaussian distribution. Then, an anomaly measurement calibration loss function is designed based on negative correlation between morphological similarity and reconstruction consistency, to calibrate the biased anomaly measurement caused by contaminated samples. Extensive experiments on various time series datasets show that the proposed NegCo outperforms state-of-the-art baselines, achieving an improvement of 6.2% to 26.8% in A rea U nder the R eceiver O perating C haracteristics (AUROC) scores, particularly in scenarios with heavily contaminated training data. • Unsupervised time series anomaly detection under data contamination. • Calibrating the biased anomaly measurement by exploiting the negative correlation. • Normal samples from a learned Gaussian distribution to model negative correlation. • Single forward propagation enables anomaly detection using the trained autoencoder. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
25. Large width nearest prototype classification on general distance spaces.
- Author
-
Anthony, Martin and Ratsaby, Joel
- Subjects
- *
PROTOTYPE equipment , *PROTOTYPES , *TRIANGLE inequality , *FUNCTIONAL analysis , *BINARY codes - Abstract
In this paper we consider the problem of learning nearest-prototype classifiers in any finite distance space; that is, in any finite set equipped with a distance function. An important advantage of a distance space over a metric space is that the triangle inequality need not be satisfied, which makes our results potentially very useful in practice. We consider a family of binary classifiers for learning nearest-prototype classification on distance spaces, building on the concept of large-width learning which we introduced and studied in earlier works. Nearest-prototype is a more general version of the ubiquitous nearest-neighbor classifier: a prototype may or may not be a sample point. One advantage in the approach taken in this paper is that the error bounds depend on a ‘width’ parameter, which can be sample-dependent and thereby yield a tighter bound. [ABSTRACT FROM AUTHOR]
- Published
- 2018
- Full Text
- View/download PDF
26. Matrix-Binary Codes based Genetic Algorithm for path planning of mobile robot.
- Author
-
Patle, B.K., Parhi, D.R.K., Jagadeesh, A., and Kashyap, Sunil Kumar
- Subjects
- *
BINARY codes , *GENETIC algorithms , *MOBILE robot programming , *NAVIGATION equipment - Abstract
The paper presents the new variant of genetic algorithm using the binary codes through matrix for mobile robot navigation (MRN) in static and dynamic environment. The path planning strategy is established using the trace theory as the optimum controller, Sylvester Law of Inertia (SLI) and matrix simulation. The Matrix-Binary Codes based Genetic Algorithm (MGA) transforms the environment from chaos to array. Importantly, the paper proves the SLI by the real and experimental results for the statement “any robotics randomized environment transforms into the array.” Hence the model is presented as pre-optimized robotics by SLI and post-optimized robotics by trace. The simulation result is presented by using MATLAB software and the result obtained by proposed controller is optimal with respect to path and time when compared to other intelligent navigational controller. [ABSTRACT FROM AUTHOR]
- Published
- 2018
- Full Text
- View/download PDF
27. Orbit codes of finite Abelian groups and lattices.
- Author
-
Mesnager, Sihem and Raja, Rameez
- Subjects
- *
FINITE groups , *ORBITS (Astronomy) , *ABELIAN groups , *LINEAR codes , *AUTOMORPHISMS , *BINARY codes , *HOMOMORPHISMS - Abstract
This paper constructs a class of lattices whose discrete analogues are variable-length non-linear codes. The well-known discrete analogue of lattices and linear codes inspires our approach. We next design a variable length binary non-linear code called automorphism orbit code from a finite abelian p -group of rank greater than 1, where p is a prime. For each finite abelian p -group, codewords of the automorphism orbit code are variable-length codewords called automorphism orbit codewords. The homomorphisms between groups determine homomorphism codes , whereas automorphism orbit codes are specified by partitions of a number, orbits of group action, homomorphisms and automorphisms of groups. For some groups G and H , we shall use elements of H o m (G , H) to create a cover relation for bit strings of codewords of an automorphism orbit code and formulate a lattice of variable length non-linear codes. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
28. On new infinite families of completely regular and completely transitive codes.
- Author
-
Borges, J., Rifà, J., and Zinoviev, V.
- Subjects
- *
AUTOMORPHISM groups , *GROBNER bases , *BINARY codes - Abstract
In two previous papers we constructed new families of completely regular codes by concatenation methods. Here we determine cases in which the new codes are completely transitive. For these cases we also find the automorphism groups of such codes. For the remaining cases, we show that the codes are not completely transitive assuming an upper bound on the order of the monomial automorphism groups, according to computational results. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
29. IIOF: Intra- and Inter-feature orthogonal fusion of local and global features for music emotion recognition.
- Author
-
Chang, Pei-Chun, Chen, Yong-Sheng, and Lee, Chang-Hsing
- Subjects
- *
EMOTION recognition , *MUSIC & emotions , *FEATURE extraction , *BINARY codes - Abstract
In this paper, we propose intra- and inter-feature orthogonal fusion (IIOF) of local and global features obtained from MS-SincResNet or MS-SSincResNet (a variant of MS-SincResNet) for music emotion recognition (MER). Given a raw waveform of music signal, MS-SincResNet/MS-SSincResNet is first used to learn several 2D representations having different receptive fields and obtain embeddings with time-frequency information from different layers. Then, local and global features are extracted from these embeddings. IIOF consisting of intra-feature OF and inter-feature OF is further employed to integrate both local and global features to obtain a discriminative descriptor for MER. The intra-feature OF is used to enhance the diversity of the global feature, and the inter-feature OF is utilized to reduce redundancies and produce complementary information between local and global features. The experimental results have demonstrated that the representation discriminability can be enhanced by IIOF considering the feature orthogonality. Furthermore, extensive experimental results have shown that the proposed method outperforms other state-of-the-art methods in terms of regression and classification tasks on the well-known MER datasets, including the DEAM dataset and the PMEmo dataset. The codes are available at https://github.com/PeiChunChang/MS-SSincResNet_with_IIOF. • We propose IIOF approach to effectively integrating local and global features. • IIOF is combined with MS-SincResNet and MS-SSincResNet for music emotion recognition. • The proposed method outperforms other state-of-the-art methods. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
30. On generalized quasi-cyclic codes over [formula omitted].
- Author
-
Meng, Xiangrui, Gao, Jian, and Fu, Fang-Wei
- Subjects
- *
BINARY codes , *CODING theory , *CYCLIC codes , *LINEAR codes - Abstract
Based on good algebraic structures and practicabilities, generalized quasi-cyclic (GQC) codes play important roles in coding theory. In this paper, we study some results on GQC codes over Z 4 including normalized generating sets, minimal generating sets and normalized generating sets of their dual codes. As an application, new Z 4 -linear codes and good binary nonlinear codes are constructed from GQC codes over Z 4. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
31. Multi-user image retrieval with suppression of search pattern leakage.
- Author
-
Liu, Hong, Zhang, Yushu, Xiang, Yong, Liu, Bo, and Guo, ErChuan
- Subjects
- *
IMAGE retrieval , *CONTENT-based image retrieval , *BINARY codes , *LEAKAGE , *IMAGE databases , *SECURITY management - Abstract
In image retrieval applications for multi-users, users can retrieve similar images in a database. The server can collude with the user and exploit the search patterns to infer the information of other users, which may cause search pattern leakage. However, current forward privacy solutions can only partially solve the problem. In this paper, a multi-user image retrieval scheme, called multi-user image retrieval with suppression of search pattern (MIRSP), is presented to suppress the search pattern leakage. This scheme uses a blockchain structure to establish an optimized tree index. Meanwhile, compressive sensing is used to convert high-dimensional feature vectors into similarity-preserving binary codes, which reduces the similarity calculation cost and guarantees the security of nodes. Then, a path shuffling algorithm is proposed to hide the identifier and position of the search nodes. Finally, a fully trusted certificate authority center is added to ensure the security management and distribution of keys and avoid unnecessary communication overhead. Our experimental evaluation shows that the proposed MIRSP is 3 × faster than the state-of-the-art schemes in search computation times, which demonstrates that MIRSP contributes significantly in providing security and privacy protection in multi-user scenarios. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
32. Capturing combination patterns of long- and short-term dependencies in multivariate time series forecasting.
- Author
-
Song, Wen and Fujimura, Shigeru
- Subjects
- *
DEEP learning , *FORECASTING , *ELECTRIC power consumption , *SOLAR energy , *TIME series analysis , *BINARY codes - Abstract
Multivariate time series forecasting has typically been a relevant and interesting topic in many fields, including economics, electricity consumption, solar energy, and traffic management. In these domains, owing to the complex dependencies among multiple variables and the mixed dependencies in the time dimension, it is challenging to forecast a multivariate time series precisely. Furthermore, most of the forecasting methods fail to capture the mixed influence of the different time-length dependencies among multiple variables. In this paper, a new deep learning framework is proposed for dealing with this challenging problem, named as mixed dependence time-series network (MDTNet). In this framework, stacked dilated convolutions and recurrent units are applied to extract the complex patterns in the long- and short-term mixed dependencies among multiple variables. The experiments show that our proposed framework yields significant results, outperforming the state-of-the-art baseline methods on three of the four benchmark datasets in large horizons and achieving a competitive performance in short horizons on all the benchmark datasets. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
33. Terahertz binary coder based on graphene metasurface.
- Author
-
Gong, Yumin, Hu, Fangrong, Jiang, Mingzhu, Zhang, Longhui, Zou, Yingchang, Jiang, Guobao, and Liu, Yongchen
- Subjects
- *
TERAHERTZ materials , *GRAPHENE , *UNIT cell , *FERMI energy , *BINARY codes , *AMPLITUDE modulation - Abstract
In this paper, we demonstrate a terahertz (THz) binary encoder based on graphene metasurface. The unit cell of the device consists of two parallel metal bars and two split-ring resonators (SRRs) embedded with two graphene ribbons. For two SRRs in the unit cell, one is connected to an electrode on the right side, and the other is connected to the electrode on the left side of the device, respectively. When no voltage is applied, the device has two passbands whose central frequencies locating at 0.85 THz and 1.14 THz, respectively. Unlike many THz tunable filters which modulate the amplitude of different bands at the same time, this encoder can achieve separately modulation of each passband. By electrically adjusting the Fermi energy of graphene on each SRR individually, the maximum modulation depth at the two central frequencies can be up to 80% and 87%, respectively. Furthermore, the function of THz frequency range binary coding is realized, i.e., four different binary coders of 11, 10, 01 and 00 are obtained in the transmission. Our work paves a new way for the development of multifunctional integrated THz devices, which will be of great significance in THz switching, communication and one-chip integrated THz system. We demonstrate a terahertz (THz) binary encoder based on graphene metasurface. The unit cell of the device consists of two parallel metal bars and two split-ring resonators (SRRs) embedded with two graphene ribbons. For two SRRs in the unit cell, one is connected to an electrode on the right side biased by voltage of U 1 , and the other is connected to the left electrode biased by voltage of U 2 , respectively. When no voltage is applied, the device has two passbands whose central frequencies locating at 0.85 THz and 1.14 THz, respectively. This encoder can achieve separately modulation of each passband. By electrically adjusting the Fermi energy of graphene on each SRR individually, the maximum modulation depth at the two central frequencies can be up to 80% and 87%, respectively. Furthermore, the function of THz frequency range binary coding is realized, i.e., four different binary coders of 11, 10, 01 and 00 are obtained in the transmission. Our work paves a new way for the development of multifunctional integrated THz devices, which will be of great significance in THz switching, communication and one-chip integrated THz system. [Display omitted] [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
34. Learning sufficient scene representation for unsupervised cross-modal retrieval.
- Author
-
Luo, Jieting, Wo, Yan, Wu, Bicheng, and Han, Guoqiang
- Subjects
- *
GAUSSIAN mixture models , *MISSING data (Statistics) , *MODAL logic , *BINARY codes , *SUBMANIFOLDS , *LOGISTIC regression analysis - Abstract
In this paper, a novel unsupervised C ross- M odal retrieval method via S ufficient S cene R epresentation (CMSSR) is proposed. Distinguished from the existing methods which mainly focus on simultaneously preserving the mutually-constrained intra- and inter-modal similarity relation, CMSSR considers data of different modalities as the descriptions of a scene from different views and accordingly integrates information of different modalities to learn a complete common representation containing sufficient information of the corresponding scene. To obtain such common representation, Gaussian Mixture Model (GMM) is firstly utilized to generate statistic representation of each uni-modal data, while the uni-modal spaces are accordingly abstracted as uni-modal statistical manifolds. In addition, the common space is assumed to be a high-dimensional statistical manifold with different uni-modal statistical manifolds as its sub-manifolds. In order to generate sufficient scene representation from uni-modal data, a representation completion strategy based on logistic regression is proposed to effectively complete the missing representation of another modality. Then, the similarity between different multi-modal data can be more accurately reflected by the distance metric in common statistical manifold. Based on the distance metric in common statistical manifold, Iterative Quantization is utilized to further generate binary code for fast cross-modal retrieval. Extensive experiments on three standard benchmark datasets fully demonstrate the superiority of CMSSR compared with several state-of-the-art methods. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
35. Clustering-driven Deep Adversarial Hashing for scalable unsupervised cross-modal retrieval.
- Author
-
Shen, Xiao, Zhang, Haofeng, Li, Lunbo, Zhang, Zheng, Chen, Debao, and Liu, Li
- Subjects
- *
BINARY codes , *ACCURACY of information , *COMPUTER programming education , *INFORMATION retrieval , *BIG data - Abstract
With the advent of the big data era, multimedia data is growing rapidly, and its data modalities is also becoming diversified. Therefore, the demand for the speed and accuracy of cross-modal information retrieval is increasing. Hashing-based cross-modal retrieval technology attracts widespread attention, it encodes multimedia data into a common binary hash space, thereby effectively measuring the correlation between samples from different modalities. In this paper, we propose a novel end-to-end deep cross-modal retrieval framework, namely Clustering-driven Deep Adversarial Hashing (CDAH), which has three main characteristics. Firstly, CDAH learns discriminative clusters recursively through a soft clustering model. It attempts to generate modal-invariant representations in a common space by obfuscating the modality classifier, which tries to distinguish different modalities according to the generated representations. Secondly, in order to minimize the modal gap between feature representations from different modalities with the same semantic label, and to maximize the distance between images and texts with different labels, CDAH constructs a fused-semantics matrix to integrate the original domain information from different modalities, serving as self-supervised information to refine the binary codes. Finally, CDAH skillfully uses a scaled tanh function to adaptively learn the binary codes, which will gradually converge to the original tricky binary coding problem. We conduct comprehensive experiments on four popular datasets, and the experimental results demonstrate the superiority of our model against the state-of-the-art methods. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
36. Hashing person re-ID with self-distilling smooth relaxation.
- Author
-
Jin, Hanyang, Lai, Shenqi, Zhao, Guoshuai, and Qian, Xueming
- Subjects
- *
BINARY codes , *COMPUTER programming education , *PREDICTION models - Abstract
Person re-identification (re-ID) has made substantial progress in recent years; however, it is still challenging to search for the target person in a short time. Re-ID with deep hashing is a shortcut for that but, limited by the expression of binary code, the performance of the hashing method is not satisfactory. Besides, to further speed up retrieval, researchers tend to reduce the number of feature bits, which will cause more performance degradation. In this paper, we design the attribute-based fast retrieval (AFR), which leverages the attribute prediction of the model trained in a binary classification manner tailor-made for hashing. The attribute information is also used to refine the global feature representation by an attribute-guided attention block (AAB). Then, to fully exploit deep feature to generate the hash codes, we propose a binary code learning method, named self-distilling smooth relaxation (SSR). In this method, a simple yet effective regularization is presented to distill the quantized knowledge in the model itself, thus mitigating the lack of semantic guidance in the traditional non-linear relaxations. We manually label attributes for each person in dataset CUHK03 and evaluate our method on four authoritative public benchmarks (Market-1501, Market-1501+500K, CUHK03, and DukeMTMC-reID). The experimental results indicate that with the SSR and AAB, we surpass all the state-of-the-art hashing methods. And compared with reducing the feature bits, the AFR strategy is more effective to save search time. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
37. Hard Decorrelated Centralized Loss for fine-grained image retrieval.
- Author
-
Zeng, Xianxian, Liu, Shun, Wang, Xiaodong, Zhang, Yun, Chen, Kairui, and Li, Dong
- Subjects
- *
IMAGE retrieval , *BINARY codes , *CONVOLUTIONAL neural networks , *VISUAL fields - Abstract
• A novel variant of softmax loss based on hard mining is proposed to FGIR. • The proposed loss can separate the closest subspecies of fine-grained image. • Extensive experiments on several classical benchmarks demenstrate its effectiveness. Although there is abundant of investigations on fine-grained image retrieval, it is still an extremely challenging task in the field of computer vision, due to the character of small diversity in inter-class but large diversity within intra-class. To handle this task, loss functions are critical to the performance of a deep convolutional neural network in extracting the discriminative feature of the fine-grained image for retrieval. Recent studies showed that the global structure loss functions help to extract more discriminative features. In this paper, we introduce a novel global structure loss function, named Hard Decorrelated Centralized Loss, for further improving the representation for fine-grained image retrieval. The proposed loss is available in extracting the discriminative feature for dividing the most similar categories. In our experiments, we employ the proposed loss to train the convolutional neural network, which shows state-of-the-art performances on six classical fine-grained image retrieval benchmarks, e.g. CUB-200-2011 and Stanford Cars. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
38. Deep asymmetric hashing with dual semantic regression and class structure quantization.
- Author
-
Lu, Jianglin, Wang, Hailing, Zhou, Jie, Yan, Mengfan, and Wen, Jiajun
- Subjects
- *
BINARY codes , *NETWORK performance , *COMPUTER programming education , *IMAGE retrieval - Abstract
• We propose a novel deep supervised hashing framework called DSAH, which adopts an interesting similarity preserving strategy based on distance-similarity product function. • DSAH subtly incorporates class prior of data into the quantization stage, thereby providing discriminative feedback for network training. • A dual semantic regression loss supported by a simple yet effective label mechanism is designed to characterize the intra-class compactness and inter-class separability of data. Recently, deep hashing methods have been widely used in image retrieval task. Most existing deep hashing approaches adopt one-to-one quantization to reduce information loss. However, such class-unrelated quantization cannot give discriminative feedback for network training. In addition, these methods only utilize single label to integrate supervision information of data for hashing function learning, which may result in inferior network generalization performance and relatively low-quality hash codes since the inter-class information of data is totally ignored. In this paper, we propose a dual semantic asymmetric hashing (DSAH) method, which generates discriminative hash codes under threefold constraints. Firstly, DSAH utilizes class prior to conduct class structure quantization so as to transmit class information during the quantization process. Secondly, a simple yet effective label mechanism is designed to characterize both the intra-class compactness and inter-class separability of data, thereby achieving semantic-sensitive binary code learning. Finally, a meaningful pairwise similarity preserving loss is devised to minimize the distances between class-related network outputs based on an affinity graph. With these three main components, high-quality hash codes can be generated through network. Extensive experiments conducted on various data sets demonstrate the superiority of DSAH in comparison with state-of-the-art deep hashing methods. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
39. Skip-connected network with gram matrix for product image retrieval.
- Author
-
Dai, Yong, Li, Yi, Sun, Bin, and Liu, Li-Jun
- Subjects
- *
PRODUCT image , *MATRIX multiplications , *IMAGE retrieval , *BINARY codes - Abstract
Designers usually retrieve and review existing relevant product images to draw inspiration when designing a new proposal. Obtaining reasonable retrieval results of a given target is a challenging task due to the large-scale, low-correlation searching process in the product image field. In this paper, an end-to-end skip-connected network is introduced to improve the accuracy of retrieval by directly addressing the above problems. In more detail, skip-connections are employed to combine the multi-resolution feature maps produced by a pre-trained backbone network, which provides important improvements to address the presence of large scale variance problem. And the second-order information of the multi-resolution feature maps is obtained by using gram matrix operation, which allows the network to exploit more representative features and their correlations. Experimental results indicate that the proposed method achieves better retrieval performance when compared to current state-of-the-art techniques on there normal benchmark datasets as well as the product image data. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
40. A Robust Feature Descriptor for Biomedical Image Retrieval.
- Author
-
Das, P. and Neelima, A.
- Subjects
IMAGE retrieval ,COMPUTER-aided diagnosis ,ZERNIKE polynomials ,CURVES ,MEDICAL specialties & specialists ,BINARY codes ,MAGNETIC resonance imaging - Abstract
• A robust approach for biomedical image retrieval. • Feature vector based on Zenrike moment features, curvelet features and Gradient orientation. • Focuses on both texture and shape information with minimum redundant data. • Experiments are conducted on four benchmark biomedical image databases. Biomedical image retrieval is a crucial side of computer-aided diagnosis. It helps the radiologist and medical specialist to spot and perceive the specific disease. This paper proposed an efficient approach for retrieving similar biomedical images based on the Zernike moment features, curvelet features and histogram of oriented gradients (HOG) feature. The Zernike polynomials based moments set defines the Zernike moment which is a global descriptor and it is capable of extracting both texture and shape information with minimum redundant data. The curvelet transformation is used to compute the edge-based shape information in form of curvelet histogram for the curves with discontinuity and the HOG features calculate the happenings of gradient orientation in the local areas of an image. The experiments were conducted on four benchmark biomedical image databases: HRCT dataset, Emphysema CT database, OASIS MRI database and NEMA MRI database respectively. The performance of the proposed approach was compared with many existing methods and achieved a better retrieval rate on all the four databases. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
41. Improved Algorithm for the Network Alignment Problem with Application to Binary Diffing.
- Author
-
Mengin, Elie and Rossi, Fabrice
- Subjects
MESSAGE passing (Computer science) ,BINARY codes - Abstract
In this paper, we present a novel algorithm to address the Network Alignment problem. It is inspired from a previous message passing framework of Bayati et al. [2] and includes several modifications designed to significantly speed up the message updates as well as to enforce their convergence. Experiments show that our proposed model outperforms other state-of-the-art solvers. Finally, we propose an application of our method in order to address the Binary Diffing problem. We show that our solution provides better assignment than the reference differs in almost all submitted instances and outline the importance of leveraging the graphical structure of binary programs. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
42. Remote sensing image classification based on the optimal support vector machine and modified binary coded ant colony optimization algorithm.
- Author
-
Wang, Mingwei, Wan, Youchuan, Ye, Zhiwei, and Lai, Xudong
- Subjects
- *
SUPPORT vector machines , *REMOTE sensing , *BINARY codes , *ANT algorithms , *SWARM intelligence , *FEATURE selection - Abstract
Support vector machine (SVM) is one of the most successful classifiers for remote sensing image classification. However, the performance of SVM is mainly dependent on its parameters; in addition, for remote sensing images with high-dimensional features, feature redundancy will have a major influence on the classification efficiency and accuracy. Feature selection and parameter optimization are two important factors for improving the performance of SVM and are traditionally solved separately. In fact, these two issues are affected by each other, so to obtain the better classification performance, selection of the optimal feature subset and tuning of SVM parameters should be considered simultaneously, as they both belong to the combinatorial optimization problem and could be handled with evolutionary algorithms or swarm intelligence algorithms. In this paper, a remote sensing image classification technique based on the optimal SVM is proposed, in which the parameters of SVM and feature selection are handled integrally by a modified coded ant colony optimization algorithm combined with genetic algorithm. The results are compared with other evolutionary algorithms and swarm intelligence algorithms, such as genetic algorithm (GA), binary-coded particle swarm optimization (BPSO) algorithm, binary-coded ant colony optimization (BACO) algorithm, binary-coded differential evolution (BDE) algorithm, and binary-coded cuckoo search (BCS) algorithm. It is demonstrated that the proposed method is robust, adaptive and exhibits the better performance than the other methods involved in the paper in terms of fitness values, so could be suitable for some practical applications. [ABSTRACT FROM AUTHOR]
- Published
- 2017
- Full Text
- View/download PDF
43. CHOP: An orthogonal hashing method for zero-shot cross-modal retrieval.
- Author
-
Yuan, Xu, Wang, Guangze, Chen, Zhikui, and Zhong, Fangming
- Subjects
- *
ORTHOGRAPHIC projection , *BINARY codes , *KNOWLEDGE transfer - Abstract
• A new hashing method(CHOP) based on orthogonal projection is proposed. • Orthogonal-constrained and hash codes are used to connect seen and unseen classes. • CHOP can improve the discriminative of hash codes, and avoid the hubness problem. • Extensive experiments and results indicate the effectiveness of the proposed CHOP. Cross-modal retrieval has recently attracted much attention because it helps users retrieve data across different modalities. However, with the explosive growth of data, a large number of new emerging concepts (unseen classes) that have not been appeared in the training data (seen classes) bring great challenges to the traditional cross-modal retrieval. Nevertheless, most existing approaches mainly focus on improving cross-modal retrieval performance of seen classes, which may fail in the unseen classes. To address the challenge of zero-shot cross-modal retrieval, we propose an orthogonal method in this paper, i.e., Cross-modal Hashing with Orthogonal Projection (CHOP). It projects cross-modal features and class attributes onto a Hamming space, where each projection of cross-modal features is orthogonal to the mismatched class attributes. By so doing, the model can learn a discriminative and binary representation of each modality. In addition, the class attributes build a bridge to transfer knowledge from seen classes to unseen classes. Furthermore, the orthogonal constraint on binary codes can help to mitigate the hubness problem. Extensive experiments on three benchmark datasets show that the proposed CHOP is effective in handling zero-shot cross-modal retrieval. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
44. Automatically transforming full length biomedical articles into search queries for retrieving related articles.
- Author
-
Bashir, Shariq, Khattak, Akmal Saeed, and Alshara, Mohammed Ali
- Subjects
DECISION support systems ,INFORMATION retrieval ,KEYWORD searching ,BINARY codes - Abstract
Searching relevant articles from medical resources is an important search task in clinical decision support system. The technical contents and long length of biomedical articles make this search task more complicated than many other search tasks. Previous research on biomedical information retrieval (IR) is typically based on keyword search. In this paper we propose a new approach. Using our approach, a user can use the full article as a query. This reduces the burden on the users and generates an effective automatic query from many more useful search features. In this novel search scenario, we explore in detail several important factors for developing a successful biomedical articles retrieval system, especially focusing on how to automatically convert an article into an effective search query. Specifically, we evaluate the performance of single features with different parameter configurations, as well as combinations of these features using the techniques of learning to rank and rank fusion. Experimental results on PubMed collection show that the introduction field is the most useful feature for transforming a query. Furthermore, our experiments showed that combining multiple features can significantly improve the effectiveness of a search system. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
45. Efficient android malware identification with limited training data utilizing multiple convolution neural network techniques.
- Author
-
Ksibi, Amel, Zakariah, Mohammed, Almuqren, Latifah, and Alluhaidan, Ala Saleh
- Subjects
- *
CONVOLUTIONAL neural networks , *FEATURE extraction , *MALWARE , *DEEP learning , *BINARY codes , *MACHINE learning - Abstract
The Internet of Things (IoT) has experienced phenomenal expansion over the past few years and has emerged as one of the most dynamic sectors of the international market. Android has become the driving force behind the rapid development of the IoT, and malware is one of the most severe concerns. Android is an open-source platform with a significant number of users. The identification of Android malware has become more critical in cybersecurity due to the meteoric rise of Android malware over the past few years and the severity of the damage it inflicts on smartphone users. Existing traditional Android malware detection methods based on machine learning have achieved encouraging performance. Still, the solution requires a massive workforce of feature engineering to build dynamic or static features and continuous learning through pre-extracted features to maintain high performance in identifying malware. Therefore, technologies for end-to-end malware detection without human interaction are necessary. In response to the rapid evolution of Android malware, a convolutional neural network that can acquire knowledge without requiring feature extraction is ideally suited. This paper offers a unique classification approach for malware based on a convolutional neural network, with feature extraction selected from the current pre-trained models DenseNet169, Xception, InceptionV3, ResNet50, and VGG16. The proposed methods have an advantage over existing detection methods due to their end-to-end learning process. Our suggested approaches convert Android APK files to binary codes and RGB images for usage as inputs to deep learning models. These models are trained and evaluated using the CICInvesAndMal2019 dataset, which consists of 333 benign and 428 malicious applications. Experiments demonstrate that the proposed approaches achieve a classification accuracy of 95.24%, 95.24%, and 95.83% for DenseNet169, InceptionV3, and VGG16, respectively, on a 761-sample dataset of malware, which is superior to other compared algorithms. Compared to previous methods, our suggested methods are more applicable to Android IoT devices since they do not require manual feature engineering and consume fewer resources. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
46. Upper bound on the number of inequivalent extended binary irreducible Goppa codes.
- Author
-
Huang, Daitao and Yue, Qin
- Subjects
- *
IRREDUCIBLE polynomials , *BINARY codes , *INTEGERS - Abstract
In this paper, we always assume that p and n > 3 are two distinct odd primes, m ≥ 2 is a positive integer, and gcd (p m , 2 n (2 2 n − 1)) ≠ 1. Set r = p 2 or r = p 3 , we determine upper bounds on the number of inequivalent extended binary irreducible Goppa codes Γ (L , g) of degree r and length 2 n + 1 , where L = F 2 n ∪ { ∞ } is the support set and each g (x) is an irreducible polynomial of degree r over F 2 n . [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
47. One for more: Structured Multi-Modal Hashing for multiple multimedia retrieval tasks.
- Author
-
Zheng, Chaoqun, Li, Fengling, Zhu, Lei, Zhang, Zheng, and Lu, Wenpeng
- Subjects
- *
BINARY codes , *MULTIMEDIA systems , *SOURCE code - Abstract
Hashing has been widely studied in support of efficient multimedia retrieval due to its high computation and storage efficiency. However, existing multimedia hashing models are designed only for specific multimedia retrieval tasks, e.g. , cross-modal retrieval and composite multi-modal retrieval. To simultaneously support multiple multimedia retrieval tasks, multiple different hashing models should be equipped in a multimedia retrieval system. This paper proposes a Structured Multi-Modal Hashing (SMMH) method, which can learn only a hash model for multiple multimedia retrieval tasks. Specifically, we generate structured hash codes by independently projecting the modality data into the Hamming space, where each part of hash codes preserves the specific characteristic of the specific modality data, and they are collaborated to represent the whole multi-modal data. To bridge the heterogeneous gap between multiple modalities, a fusion multi-modal space is constructed based on structured hash codes with label and pair-wise semantic supervision. Besides, we learn hash functions for composite multi-modal retrieval by projecting heterogeneous modalities into the collaborative multi-modal features. Finally, we develop a discrete hash optimization strategy to efficiently solve binary hash codes. Extensive experiments show that our model outperforms the strong baseline methods on multiple multimedia retrieval tasks. Source codes are available at https://github.com/ChaoqunZheng/SMMH. • The generated hash codes can simultaneously handle multiple multimedia retrieval. • There is currently no work devoted to structured hashing. • Our model sufficiently exploits the available modal features. • The hash codes are learned directly in an efficient and fast manner. • Experimental results show the superior performance of our proposed method. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
48. Neural layered min-sum decoders for cyclic codes.
- Author
-
Wang, Ming, Li, Yong, Liu, Jianqing, Guo, Taolin, Wu, Huihui, and Lau, Francis C.M.
- Subjects
CYCLIC codes ,BINARY codes ,CONGRUENCES & residues ,DECODING algorithms ,CHANNEL coding ,LINEAR network coding ,HUMAN fingerprints - Abstract
This paper proposes a low-complexity neural network decoder based on the layered min-sum algorithm to decode cyclic codes. By generalizing the layered min-sum algorithm to its neural network counterpart, the number of network weights decreases while retaining a good error correction performance. The Bose–Chaudhuri–Hocquenghem (BCH) codes, quadratic residue (QR) codes, and punctured Reed–Muller (RM) codes are selected as three exemplary binary cyclic codes. Simulation results show that the proposed neural decoder achieves superior performance with less computational complexity compared with the state-of-the-art neural network decoder. Further, a neural decoder incorporating the modified random redundant decoding (mRRD) algorithm is investigated to approach the performance of maximum-likelihood decoding for some short codes. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
49. A fast binary encoding mechanism for approximate nearest neighbor search.
- Author
-
Zhao, Hongwei, Wang, Zhen, Liu, Pingping, and Wu, Bin
- Subjects
- *
BINARY number system , *APPROXIMATION theory , *ELECTRONIC information resource searching , *COMPUTER algorithms , *DATA analysis - Abstract
In this paper, a novel approach which can map high-dimensional, real-valued data into low-dimensional, binary vectors is proposed to achieve fast approximate nearest neighbor (ANN) search. In our paper, the binary codes are required to preserve the relative similarity, which makes the Hamming distances of data pairs approximate their Euclidean distances in ANN search. Under such constraint, the distribution adaptive binary labels are obtained through a lookup-based mechanism. The perpendicular bisector planes located between two kinds of data whose binary labels are different on only one specific bit are considered as weak hash functions. As just two kinds of data are taken into consideration during generation of the weak hash functions, the final strong hash functions are formed by combining the weak ones through boosting scheme to map all kinds of data into binary codes effectively. Experimental results show that our algorithm can encode the out of samples efficiently, and the performances of our method are superior to many state-of-the-art methods. [ABSTRACT FROM AUTHOR]
- Published
- 2016
- Full Text
- View/download PDF
50. The ordinal relation preserving binary codes.
- Author
-
Zhao, Hongwei, Wang, Zhen, and Liu, Pingping
- Subjects
- *
BINARY codes , *HASHING , *COMPUTER algorithms , *INFORMATION processing , *DATA distribution - Abstract
Hashing algorithm has been widely used for efficient approximate nearest neighbor (ANN) search. Learning optimal hashing functions has been given focus and it is still a challenge. This paper aims to effectively and efficiently generate relative similarity preserving binary codes. Most existing hashing methods try to preserve the locality similarity by preserving direct distance similarity, while ignoring the relative similarity which advantages in ANN search. In this paper, this issue is solved by proposing the relative error which emphasizes that the ordinal relations in Hamming space and Euclidean space should be consistent with each other. We learn hashing projection functions via two steps. The first step adopts the lookup-based mechanism to find the optimal binary codes of training data, which can preserve the relative similarity and simultaneously adapt to data distribution. The binary codes in the first step are considered as supervision information in the second step. The objective of the second step is to learn hashing projection functions which can efficiently regenerate the binary codes in the first step. Aim to be in accordance with the property of data distribution, the hyper internal tangent planes of two specified spheres are chosen as hashing projection functions. Assisted by these projection functions, the time complexity of encoding process is greatly reduced. Experimental results on four public data sets demonstrate that our method outperforms many other state-of-the-art methods. [ABSTRACT FROM AUTHOR]
- Published
- 2015
- Full Text
- View/download PDF
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.