QC4 - A Clustering Evaluation Method

  • Daniel Crabtree
  • Peter Andreae
  • Xiaoying Gao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4426)


Many clustering algorithms have been developed and researchers need to be able to compare their effectiveness. For some clustering problems, like web page clustering, different algorithms produce clusterings with different characteristics: coarse vs fine granularity, disjoint vs overlapping, flat vs hierarchical. The lack of a clustering evaluation method that can evaluate clusterings with different characteristics has led to incomparable research and results. QC4 solves this by providing a new structure for defining general ideal clusterings and new measurements for evaluating clusterings with different characteristics with respect to a general ideal clustering. The paper describes QC4 and evaluates it within the web clustering domain by comparison to existing evaluation measurements on synthetic test cases and on real world web page clustering tasks. The synthetic test cases show that only QC4 can cope correctly with overlapping clusters, hierarchical clusterings, and all the difficult boundary cases. In the real world tasks, which represent simple clustering situations, QC4 is mostly consistent with the existing measurements and makes better conclusions in some cases.


Mutual Information Cluster Quality Cluster Evaluation Topic Coverage Real World Task 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Steinbach, M., Karypis, G., Kumar, V.: A comparison of document clustering techniques. In: KDD Workshop on Text Mining (2000),
  2. 2.
    Ali, R., Ghani, U., Saeed, A.: Data clustering and its applications (1998),
  3. 3.
    Wang, Y., Kitsuregawa, M.: Evaluating contents-link coupled web page clustering for web search results. In: 11th Int. Conf. on Information and Knowledge Management (CIKM ’2002), McLean, VA, USA, pp. 499–506. ACM Press, New York (2002)CrossRefGoogle Scholar
  4. 4.
    Zamir, O.E.: Clustering Web Documents: A Phrase-Based Method for Grouping Search Engine Results. PhD thesis, University of Washington (1999)Google Scholar
  5. 5.
    Crabtree, D., Gao, X., Andreae, P.: Improving web clustering by cluster selection. In: 2005 IEEE/WIC/ACM Int. Conf. on Web Intelligence, September 2005, pp. 172–178. ACM Press, New York (2005)CrossRefGoogle Scholar
  6. 6.
    Crabtree, D., Andreae, P., Gao, X.: Query directed web page clustering. In: 2006 IEEE/WIC/ACM Int. Conf. on Web Intelligence, December 2006, pp. 202–210. ACM Press, New York (2006)CrossRefGoogle Scholar
  7. 7.
    Halkidi, M., Batistakis, Y., Vazirgiannis, M.: On clustering validation techniques. Journal of Intelligent Information Systems 17(2-3), 107–145 (2001)zbMATHCrossRefGoogle Scholar
  8. 8.
    Strehl, A.: Relationship-based Clustering and Cluster Ensembles for High-dimensional Data Mining. PhD thesis, Faculty of the Graduate School of The University of Texas at Austin (2002)Google Scholar
  9. 9.
    Tonella, P., et al.: Evaluation methods for web application clustering. In: 5th Int. Workshop on Web Site Evolution, Amsterdam, The Netherlands (2003)Google Scholar
  10. 10.
    Meila, M.: Comparing clusterings. Technical Report 418, Department of Statistics, University of Washington (2002)Google Scholar
  11. 11.
    Wong, W.-c., Fu, A.: Incremental document clustering for web page classification. In: IEEE 2000 Int. Conf. on Info. Society in the 21st century: emerging technologies and new challenges (IS2000), Japan, November 2000, IEEE Computer Society Press, Los Alamitos (2000), Google Scholar
  12. 12.
    Crabtree, D., Gao, X., Andreae, P.: Standardized evaluation method for web clustering results. In: 2005 IEEE/WIC/ACM Int. Conf. on Web Intelligence, September 2005, pp. 280–283. ACM Press, New York (2005)CrossRefGoogle Scholar
  13. 13.
    van Rijsbergen, C.J.: Information Retrieval. Butterworths, London (1979)Google Scholar
  14. 14.
    Mackay, D.J.: Information Theory, Inference, and Learning Algorithms. Cambridge University Press, Cambridge (2003)zbMATHGoogle Scholar

Copyright information

© Springer Berlin Heidelberg 2007

Authors and Affiliations

  • Daniel Crabtree
    • 1
  • Peter Andreae
    • 1
  • Xiaoying Gao
    • 1
  1. 1.School of Mathematics, Statistics and Computer Science, Victoria University of WellingtonNew Zealand

Personalised recommendations