Regularized Fuzzy c-Means Clustering and its Behavior at Point of Infinity
Yuchi Kanzawa* and Sadaaki Miyamoto**
*Shibaura Institute of Technology
3-7-5 Toyosu, Koto, Tokyo 135-8548, Japan
**University of Tsukuba
1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573, Japan
This study shows that a general regularized fuzzy c-means (rFCM) clustering algorithm, including some conventional clustering algorithms, can be constructed if a given regularizer function value, its derivative function value, and its inverse derivative function value can be calculated. Furthermore, the results of the study show that the behavior of the fuzzy classification function for rFCM at an infinity point is similar to that for some conventional clustering algorithms.
-  J. B. MacQueen, “Some Methods of Classification and Analysis of Multivariate Observations,” Proc. 5th Berkeley Symp. on Math. Stat. and Prob., pp. 281-297, 1967.
-  S. Miyamoto and M. Mukaidono, “Fuzzy c-Means as a Regularization and Maximum Entropy Approach,” Proc. 7th Int. Fuzzy Systems Association World Congress (IFSA’97), Vol.2, pp. 86-92, 1997.
-  S. Miyamoto and K. Umayahara, “Fuzzy Clustering by Quadratic Regularization,” Proc. 1998 IEEE Int. Conf. Fuzzy Syst., pp. 1394-1399, 1998.
-  Y. Kanzawa, “Generalization of Quadratic Regularized and Standard Fuzzy c-Means Clustering with respect to Regularization of Hard c-Means,” Lecture Notes in Computer Science, Vol.8234, pp. 152-165, 2013.
-  S. Miyamoto and K. Umayahara, “Methods in Hard and Fuzzy Clustering,” Z.-Q. Liu and S. Miyamoto (Eds.), Soft Computing and Human-Centered Machines, Springer-Verlag, Tokyo, 2000.
-  S. Miyamoto, H. Ichihashi, and K. Honda, “Algorithms for Fuzzy Clustering,” Springer, 2008.
-  C. C. Popescu, “A clustering model with Rényi entropy regularization,” Mathematical Reports, Vol.11, No.1, pp. 59-66, 2009.
-  J. Bezdek, “Pattern Recognition with Fuzzy Objective Function Algorithms,” Plenum Press, New York, 1981.
-  S. Miyamoto and N. Kurosawa, “Controlling Cluster Volume Sizes in Fuzzy c-means Clustering,” Proc. SCIS&ISIS2004, pp. 1-4, 2004.
-  H. Ichihashi, K. Honda, and N. Tani, “Gaussian Mixture PDF Approximation and Fuzzy c-means Clustering with Entropy Regularization,” Proc. 4th Asian Fuzzy System Symp., pp. 217-221, 2000.
-  I. S. Dhillon and D. S. Modha, “Concept Decompositions for Large Sparse Text Data Using Clustering,” Machine Learning, Vol.42, pp. 143-175, 2001.
-  S. Miyamoto and K. Mizutani, “Fuzzy Multiset Model and Methods of Nonlinear Document Clustering for Information Retrieval,” Lecture Notes in Computer Science, Vol.3131, pp. 273-283, 2004.
-  K. Mizutani, R. Inokuchi, and S. Miyamoto, “Algorithms of Nonlinear Document Clustering based on Fuzzy Set Model,” Int. J. of Intelligent Systems, Vol.23, No.2, pp. 176-198, 2008.
-  Y. Kanzawa, “On Kernelization for a Maximizing Model of Bezdek-like Spherical Fuzzy c-means Clustering,” Lecture Notes in Computer Science, Vol.8825, pp. 108-121, 2014.
-  Y. Kanzawa, “A Maximizing Model of Bezdek-like Spherical Fuzzy c-Means,” J. Adv. Comput. Intell. Intell. Inform., Vol.19, No.5, pp. 662-669, 2015.
-  Y. Kanzawa, “A Maximizing Model of Spherical Bezdek-type Fuzzy Multi-medoids Clustering,” J. Adv. Comput. Intell. Intell. Inform., Vol.19, No.6, pp. 738-746, 2015.
-  C. Oh, K. Honda, and H. Ichihashi, “Fuzzy Clustering for Categorical Multivariate Data,” Proc. IFSA World Congress and 20th NAFIPS Int. Conf., pp. 2154-2159, 2001.
-  K. Honda, S. Oshio, and A. Notsu, “FCM-type fuzzy co-clustering by K-L information regularization,” Proc. of 2014 IEEE Int. Conf. on Fuzzy Systems, pp. 2505-2510, 2014.
-  K. Honda, S. Oshio, and A. Notsu, “Item Membership Fuzzification in Fuzzy Co-clustering Based on Multinomial Mixture Concept,” Proc. of 2014 IEEE Int. Conf. on Granular Computing, pp. 94-99, 2014.
-  Y. Kanzawa, “Fuzzy Co-Clustering Algorithms Based on Fuzzy Relational Clustering and TIBA Imputation,” J. Adv. Comput. Intell. Intell. Inform., Vol.18, No.2, pp. 182-189, 2014.
-  Y. Kanzawa, “On Possibilistic Clustering Methods Based on Shannon/Tsallis-Entropy for Spherical Data and Categorical Multivariate Data,” Lecture Notes in Computer Science, Vol.9321, pp. 125-138, 2015.
-  Y. Kanzawa, “Bezdek-type Fuzzified Co-Clustering Algorithm,” J. Adv. Comput. Intell. Intell. Inform., Vol.19, No.6, pp. 852-860, 2015.