Fujipress Home | Search | About FINDER

Language: English:

Semi-Supervised Pattern Classification Utilizing Fuzzy Clustering and Nonlinear Mapping of Data

Weiwei Du and Kiichi Urahama

Department of Visual Communication Design, Kyushu University, 4-9-1 Shiobaru, Fukuoka 815-8540, Japan

Received: May 26, 2007

Accepted: July 12, 2007

Keywords: semi-supervised learning, fuzzy clustering, RBF mapping, locality preserving projection

Journal ref: Journal of Advanced Computational Intelligence and Intelligent Informatics, Vol.11, No.9 pp. 1159-1164, 2007


We present a semi-supervised algorithm for classification of arbitrarily distributed patterns. We project data into a classification space through two stages, first is a nonlinear mapping with radial basis functions and second is a linear projection with a semi-supervised locality preserving projection. Radial basis functions are arranged by fuzzy clustering of training data. This fuzzy clustering is also exploited for selection of data to be labeled for semi-supervised learning. We devise a simple semi-supervised algorithm in which data similarity is multiplicatively modulated on the basis of label information. We examine performance of the proposed classifier with experiments for synthetic and some real data and show that our method outperforms similar graph spectral algorithms and kernel semi-supervised methods.
preview Preview (PDF)  full text Full Text (PDF 320KB)


[1] P. N. Belhumeuer, J. P. Hespanha, and D. J. Kriegman, “Eigenfaces vs. fisherfaces: recognition using class specific linear projection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.19, No.7, pp. 711-720, 1997.

[2] M. Turk and A. Pentland, “Eigenfaces for recognition,” Journal of Cognitive Neuroscience, Vol.3, No.1, pp. 71-86, 1991.

[3] X. Zhu, “Semi-supervised learning literature survey,” Computer Sciences TR 1530, Univ. Wisconsin, 2005.

[4] M. Belkin and P. Niyogi, “Laplacian eigenmaps for dimensionality reduction and data representation,” Neural Computation, Vol.15, Issue 6, pp. 1373-1396, 2003.

[5] X. He and P. Niyogi, “Locality preserving projections,” NIPS, 2003.

[6] J. Shawe-Taylor and N. Cristianini, “Kernel methods for pattern analysis,” Cambridge Univ. Press, 2004.

[7] S. Hoi and M. R. Lyu, “A semi-supervised active learning framework for image retrieval,” Proc. of the 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR’05), pp. 302-309, 2005.

[8] S. D. Kamvar, D. Klein, and C. D. Manning, “Spectral learning,” Int. Joint Conf. of Artificial Intelligence, pp. 561-566, 2003.

[9] A. Balaldi and P. Blonda, “A survey of fuzzy clustering algorithms for pattern recognition,” IEEE Transactions on Systems, Man and Cybernetics, Part B, Vol.29, pp. 778-801, 1999.

[10] R. N. Dave, “Characterization and detection of noise in clustering,” Pattern Recognition Letters, Vol.12, Issue 11, pp. 657-664, 1991.

[11] X. Zhu, Z. Ghahrmani, and J. D. Lafferty, “Semi-supervised learning using Gaussian fields and harmonic functions,” Int. Conf. on Machine Learning, pp. 912-919, 2003.

[12] D. Graham and N. Allinson, “The UMIST face database,”
http://images.ee.umist.ac.uk/danny/database.html ,

[13] D. J. Newman, S. Hettich, C. L. Blake, and C. J. Merz, “UCI Repository of machine learning databases,”
http://www1.ics.uci.edu/˜mlearn/MLRepository.html ,

[14] W. Du and K. Urahama, “Semi-Supervised Classification with Spectral Subspace Projection of Data,” IEICE Transactions on Information and Systems, Vol.E90-D, Issue 1, pp. 374-377, 2007.

[15] J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, “Face recognition using kernel direct discriminant analysis algorithms,” IEEE Transactions on Neural Networks, Vol.14, Issue 1, pp. 117-126, 2003.

[16] O. Chapelle, J. Weston, and B. Scholkopf, “Cluster kernels for semi-supervised learning,” Advances in Neural Information Processing Systems, Vol.15, pp. 585-592, 2003.

* "Preview" is the first 2 pages of the article. You don't need the registration.
* To read the PDF file you will then need to download and install the Adobe Reader.
Adobe Reader is free and available for download here:

adobe reader

Terms and Conditions | Privacy Policy | Recruit | Advertising Information | Contact Us