Please use this identifier to cite or link to this item: https://hdl.handle.net/20.500.11851/7257
Title: Parallel clustering of high dimensional data by integrating multi-objective genetic algorithm with divide and conquer
Authors: Ozyer, Tansel
Alhajj, Reda
Keywords: Clustering
Data mining
Multi-objective optimization
Validity analysis
Divide and conquer
Parallelism
Incremental clustering
Publisher: Springer
Abstract: This paper applies divide and conquer approach in an iterative way to handle the clustering process. The target is a parallelized effective and efficient approach that produces the intended clustering result. We achieve scalability by first partitioning a large dataset into subsets of manageable sizes based on the specifications of the machine to be used in the clustering process; then cluster the partitions separately in parallel. The centroid of each obtained cluster is treated like the root of a tree with instances in its cluster as leaves. The partitioning and clustering process is iteratively applied on the centroids with the trees growing up until we get the final clustering; the outcome is a forest with one tree per cluster. Finally, a conquer process is performed to get the actual intended clustering, where each instance (leaf node) belongs to the final cluster represented by the root of its tree. We use multi-objective genetic algorithm combined with validity indices to decide on the number of classes. This approach fits well for interactive online clustering. It facilitates for incremental clustering because chunks of instances are clustered as stand alone sets, and then the results are merged with existing clusters. This is attractive and feasible because we consider the clustering of only centroids after the first clustering stage. The reported test results demonstrate the applicability and effectiveness of the proposed approach.
URI: https://doi.org/10.1007/s10489-008-0129-8
https://hdl.handle.net/20.500.11851/7257
ISSN: 0924-669X
1573-7497
Appears in Collections:Bilgisayar Mühendisliği Bölümü / Department of Computer Engineering
Scopus İndeksli Yayınlar Koleksiyonu / Scopus Indexed Publications Collection
WoS İndeksli Yayınlar Koleksiyonu / WoS Indexed Publications Collection

Show full item record



CORE Recommender

SCOPUSTM   
Citations

23
checked on Mar 23, 2024

WEB OF SCIENCETM
Citations

20
checked on Mar 9, 2024

Page view(s)

30
checked on Mar 25, 2024

Google ScholarTM

Check




Altmetric


Items in GCRIS Repository are protected by copyright, with all rights reserved, unless otherwise indicated.