VQ codebook design using modified K-means algorithm with feature classification and grouping based initialization.

Vector quantization (VQ) has been successfully used in data compression and feature extraction areas. Codebook design is the essential step of VQ. The K-means algorithm is a famous data clustering technique which is also an efficient codebook design scheme. The main disadvantages of K-means algorithm lie in that the initial cluster centroids greatly affect the convergence speed and the final clustering performance. In the past two decades, many codebook initialization techniques have been proposed. However, most of these techniques do not make full use of the features of the training vectors, and some techniques require high extra computational load. This paper presents an efficient and simple technique for the conventional K-means algorithm based on feature classification and grouping. Firstly, all training vectors are classified into sixteen categories based on a two-level classifier including an edge classifier and a contrast classifier. Then, the training vectors in each category are sorted based on their norm values and divided into groups. Each group has the same size, and the centroid vector of each group is calculated as an initial codeword. Experimental results show that, compared with several typical initialization techniques, our technique can obtain a better codebook along with a faster convergence speed in a shorter time. [ABSTRACT FROM AUTHOR]