Skip to main content

An Integration of Fuzzy Association Rules and WordNet for Document Clustering

  • Conference paper
Advances in Knowledge Discovery and Data Mining (PAKDD 2009)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5476))

Included in the following conference series:

Abstract

With the rapid growth of text documents, document clustering has become one of the main techniques for organizing large amount of documents into a small number of meaningful clusters. However, there still exist several challenges for document clustering, such as high dimensionality, scalability, accuracy, meaningful cluster labels, and extracting semantics from texts. In order to improve the quality of document clustering results, we propose an effective Fuzzy Frequent Itemset-based Document Clustering (F2IDC) approach that combines fuzzy association rule mining with the background knowledge embedded in WordNet. A term hierarchy generated from WordNet is applied to discovery fuzzy frequent itemsets as candidate cluster labels for grouping documents. We have conducted experiments to evaluate our approach on Reuters-21578 dataset. The experimental result shows that our proposed method outperforms the accuracy quality of FIHC, HFTC, and UPGMA.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Beil, F., Ester, M., Xu, X.: Frequent Term-based Text Clustering. In: Int’l. Conf. on knowledge Discovery and Data Mining (KDD 2002), pp. 436–442 (2002)

    Google Scholar 

  2. Cutting, D.R., Karger, D.R., Pederson, J.O., Tukey, J.W.: Scatter/gather: a Cluster-based approach to Browsing Large Document Collections. In: 15th Int’l ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 318–329 (1992)

    Google Scholar 

  3. de Campos, L.M., Moral, S.: Learning Rules for a Fuzzy Inference Model. J. Fuzzy Sets and Systems. 59, 247–257 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  4. Fung, B., Wang, K., Ester, M.: Hierarchical Document Clustering Using Frequent Itemsets. In: SIAM Int’l Conf. on Data Mining (SDM 2003), pp. 59–70 (2003)

    Google Scholar 

  5. Hong, T.P., Lin, K.Y., Wang, S.L.: Fuzzy Data Mining for Interesting Generalized Association Rules. J. Fuzzy Sets and Systems 138(2), 255–269 (2003)

    Article  MathSciNet  Google Scholar 

  6. Hotho, A., Staab, S., Stumme, G.: Wordnet Improves Text Document Clustering. In: SIGIR Int’l Conf. on Semantic Web Workshop (2003)

    Google Scholar 

  7. Kaya, M., Alhajj, R.: Utilizing genetic algorithms to optimize membership functions for fuzzy weighted association rule mining. Applied Intelligence 24(1), 7–15 (2006)

    Article  Google Scholar 

  8. Kushal Dave, D.M.P., Lawrence, S.: Mining the Peanut Gallery: Opinion Extraction and Semantic Classification of Product Reviews. In: 12thInt’l Conf. on World Wide Web (WWW 2003), pp. 519–528 (2003)

    Google Scholar 

  9. Martín-Bautista, M.J., Sánchez, D., Chamorro-Martínez, J., Serrano, J.M., Vila, M.A.: Mining web documents to find additional query terms using fuzzy association rules. Fuzzy Sets and Systems 148(1), 85–104 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  10. Miller, G.A.: WordNet: a Lexical Database for English. J. Communications of the ACM 38(11), 39–41 (1995)

    Article  Google Scholar 

  11. Porter, M.F.: An algorithm for suffix stripping. Program 14(3), 130–137 (1980)

    Article  Google Scholar 

  12. Sedding, J., Kazakov, D.: WordNet-based Text Document Clustering. In: COLING 2004 Workshop on Robust Methods in Analysis of Natural Language Data (2004)

    Google Scholar 

  13. Steinbach, M., Karypis, G., Kumar, V.: A Comparison of Document Clustering Techniques. In: KDD 2000 Workshop on Text Mining, ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining (KDD) (2000)

    Google Scholar 

  14. Yu, H., Searsmith, D., Li, X., Han, J.: Scalable Construction of Topic Directory with Nonparametric Closed Termset Mining. In: ICDM 2004, pp. 563–566 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chen, CL., Tseng, F.S.C., Liang, T. (2009). An Integration of Fuzzy Association Rules and WordNet for Document Clustering. In: Theeramunkong, T., Kijsirikul, B., Cercone, N., Ho, TB. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2009. Lecture Notes in Computer Science(), vol 5476. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01307-2_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-01307-2_16

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-01306-5

  • Online ISBN: 978-3-642-01307-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics