Fuzzy C-Means in High Dimensional Spaces
Authors:
- 1 January 2011
- journal article
- research article
- Published by IGI Global Scientific Publishing in International Journal of Fuzzy System Applications
- Vol. 1 (1) , 1-16
Abstract
High dimensions have a devastating effect on the FCM algorithm and similar algorithms. One effect is that the prototypes run into the centre of gravity of the entire data set. The objective function must have a local minimum in the centre of gravity that causes FCM’s behaviour. In this paper, examine this problem. This paper answers the following questions: How many dimensions are necessary to cause an ill behaviour of FCM? How does the number of prototypes influence the behaviour? Why has the objective function a local minimum in the centre of gravity? How must FCM be initialised to avoid the local minima in the centre of gravity? To understand the behaviour of the FCM algorithm and answer the above questions, the authors examine the values of the objective function and develop three test environments that consist of artificially generated data sets to provide a controlled environment. The paper concludes that FCM can only be applied successfully in high dimensions if the prototypes are initialized very close to the cluster centres.Keywords
This publication has 7 references indexed in Scilit:
- Dimension induced clustering2005
- The Challenges of Clustering High Dimensional Data2004
- Outlier detection for high dimensional data2001
- Outlier detection for high dimensional dataACM SIGMOD Record, 2001
- When Is “Nearest Neighbor” Meaningful?1999
- Pattern Recognition with Fuzzy Objective Function Algorithms1981
- A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated ClustersJournal of Cybernetics, 1973