Search

The paper has been withdrawn since more effective experiments should be completed. Auto-encoders (AE) has been widely applied in different fields of machine learning. However, as a deep model, there are a large amount of learnable parameters in the AE, which would cause over-fitting and slow learning speed in practice. Many researchers have been study the intrinsic structure of AE and showed different useful methods to regularize those parameters. In this paper, we present a novel regularization method based on a clustering algorithm which is able to classify the parameters into different groups. With this regularization, parameters in a given group have approximate equivalent values and over-fitting problem could be alleviated. Moreover, due to the competitive behavior of clustering algorithm, this model also overcomes some intrinsic problems of clustering algorithms like the determination of number of clusters. Experiments on handwritten digits recognition verify the effectiveness of our novel model., Comment: The paper has been withdrawn since more effective experiments should be completed

Several fundamental properties of real complex networks, such as the small-world effect, the scale-free degree distribution, and recently discovered topological fractal structure, have presented the possibility of a unique growth mechanism and allow for uncovering universal origins of collective behaviors. However, highly clustered scale-free network, with power-law degree distribution, or small-world network models, with exponential degree distribution, are not self-similarity. We investigate networks growth mechanism of the branching-deactivated geographical attachment preference that learned from certain empirical evidence of social behaviors. It yields high clustering and spectrums of degree distribution ranging from algebraic to exponential, average shortest path length ranging from linear to logarithmic. We observe that the present networks fit well with small-world graphs and scale-free networks in both limit cases (exponential and algebraic degree distribution respectively), obviously lacking self-similar property under a length-scale transformation. Interestingly, we find perfect topological fractal structure emerges by a mixture of both algebraic and exponential degree distributions in a wide range of parameter values. The results present a reliable connection among small-world graphs, scale-free networks and topological fractal networks, and promise a natural way to investigate universal origins of collective behaviors., Comment: 14 pages, 6 figures