Advertisement

Comparative Study on Punjabi Document Clustering

  • Iknoor SinghEmail author
  • Vijay Paul Singh
  • Naveen Aggarwal
Conference paper
  • 69 Downloads
Part of the Lecture Notes in Networks and Systems book series (LNNS, volume 120)

Abstract

The objective of clustering, a class of techniques that fall under the category of machine learning is to consequently isolate information into groups called clusters. Clustering of Punjabi documents finds numerous applications in the domain of natural language processing. Currently, not much work has been done for native languages such as Punjabi. This study presents the results of certain common document clustering techniques such as agglomerative and K-means experimented with different feature extraction methods to compare its performance using intrinsic and extrinsic measures. The recently released pre-trained Punjabi word vector model by Facebook has also been experimented as one of the feature extraction methods. This study is conducted to know which combination of clustering algorithm and feature extraction technique gives the most optimum results. This study also uses a supervised approach to evaluate the results of an unsupervised learning algorithm such as clustering.

Keywords

Document clustering Natural language processing Text mining Punjabi language 

References

  1. 1.
    Gupta, V., Gurpreet S.L.: A survey of text mining techniques and applications. J. Emerg. Tech. Web Intell. 1(1), 60–76 (2009)Google Scholar
  2. 2.
    Kaur, G., Kaur, K.: Sentiment analysis on Punjabi news articles using SVM. Int. J. Sci. Res. 6(8), 414–421 (2015)Google Scholar
  3. 3.
    Baarsch, J., Celebi, E.C.: Investigation of internal validity measures for K-means clustering. In: Proceedings of the International Multi Conference of Engineers and Computer Scientists, vol. 1 (2012)Google Scholar
  4. 4.
    Steinbach, M., George K., Kumar, V.: A comparison of document clustering techniques. KDD workshop on text mining, vol. 400, 1 (2000)Google Scholar
  5. 5.
    Grave, E., Bojanowski, P., Gupta, P., Joulin, A., Mikolov, T.: Learning word vectors for 157 languages. arXiv preprint arXiv:1802.06893 (2018)
  6. 6.
    Schütze, H., Christopher, D. Manning, Raghavan, P.: Introduction to information retrieval. In: Proceedings of the International Communication of Association for Computing Machinery Conference (2008)Google Scholar
  7. 7.
    Aggarwal, C., Zhai, C.X.: A Survey of Text Clustering Algorithms. Mining Text Data, pp. 77–128. Springer, Boston (2012)Google Scholar
  8. 8.
    Wang, L., Tian., Jia, Y., Han, W.: A hybrid algorithm for web document clustering based on frequent term sets and k-means. In: Advances in Web and Network Technologies, and Information Management, pp. 198–203. Springer (2007)Google Scholar
  9. 9.
    Wei, T., Yonghe, L., Chang, H., Zhou, Q., Bao, X.: A semantic approach for text clustering using WordNet and lexical chains. Expert Syst. Appl. 42, 2264–2275 (2015)CrossRefGoogle Scholar
  10. 10.
    Amoli, P.V.: Scientific documents clustering based on text summarization. Int. J. Electr. Comput. Eng. 5(4), 2088–8708 (2015)Google Scholar
  11. 11.
    Wang, B., Liu, W., Lin, Z., Hu, X., Wei, J., Liu, C.: Text clustering algorithm based on deep representation learning. J. Eng. 16, 1407–1414 (2018)Google Scholar
  12. 12.
    Fang, J., Zivic, P., Lin, Y., Ko., A.: Enhanced text clustering based on topic clusters. U.S. Patent Application 10/049,148, filed 14 Aug 2018Google Scholar
  13. 13.
    Gupta, V., Gupta, V.: Algorithm for Punjabi text classification. Int. J. Comput. Appl. 37(11), 30–35 (2012)Google Scholar
  14. 14.
    Kaur, J., kumar, J., Saini., R.: Punjabi stop words: A Gurmukhi, Shahmukhi and Roman scripted chronicle. In: Proceedings of the ACM Symposium on Women in Research 2016. ACM (2016)Google Scholar
  15. 15.
    Gupta, V.: Algorithm for Punjabi text classification. Int. J. Comput. Appl. 37, 30–35 (2012)Google Scholar
  16. 16.
    Gupta, V.: Punjabi text classification using Naive Bayes, centroid and hybrid approach (2012)Google Scholar
  17. 17.
    Sharma, S., Gupta, V.: Domain based Punjabi text document clustering. In: Proceedings of COLING 2012: Demonstration Papers (2012)Google Scholar
  18. 18.
    Luu, T.: Approach to evaluating clustering using classification labelled data. M.S. thesis. University of Waterloo (2011)Google Scholar
  19. 19.
    Gupta, V., Lehal, G.S.: A survey of common stemming techniques and existing stemmers for Indian languages. J. Emerg. Technol. Web Intell. 2, 157–161 (2013)Google Scholar
  20. 20.
    Jha, G.N.: The TDIL program and the Indian language corpora initiative. In: Language Resources and Evaluation Conference (2012)Google Scholar
  21. 21.
    Joulin, A., Grave, E., Bojanowski, P., and Mikolov, T.: Bag of tricks for efficient text classification. arXiv preprint arXiv:1607.01759 (2016)
  22. 22.
    Ramos, J.: Using tf-idf to determine word relevance in document queries. In: Proceedings of the First Instructional Conference on Machine Learning, vol. 242 (2003)Google Scholar
  23. 23.
    Gupta, V.: Automatic Stemming of Words for Punjabi Language. Advances in Signal Processing and Intelligent Recognition Systems, pp. 73–84. Springer, Cham (2014)CrossRefGoogle Scholar
  24. 24.
    Berkhin, P.: A Survey of Clustering Data Mining Techniques. Grouping multidimensional Data, pp. 25–71. Springer, Berlin (2006)CrossRefGoogle Scholar
  25. 25.
    Napoleon, D., Pavalakodi, S.: A new method for dimensionality reduction using k-means clustering algorithm for high dimensional data set. Int. J. Comput. Appl. 13(7), 41–46 (2011)Google Scholar
  26. 26.
    Wold, S., Esbensen, K., Geladi, P.: Principal component analysis. Chemometr. Intell. Lab. Syst. 3, 37–52 (1987)Google Scholar
  27. 27.
    Ding, C., He, X.: K-means clustering via principal component analysis. In: Proceedings of the Twenty-First International Conference on Machine Learning. ACM (2004)Google Scholar
  28. 28.
    Amigó, E., Gonzalo, J., Artiles, J., Verdejo, F.: A comparison of extrinsic clustering evaluation metrics based on formal constraints. Inf. Retrieval 12(4), 461–486 (2009)CrossRefGoogle Scholar
  29. 29.
    Hossin, M., Sulaiman., M.N.: A review on evaluation metrics for data classification evaluations. Int. J. Data Min. Knowl. Manag. Process 5(2), 1 (2015)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  • Iknoor Singh
    • 1
    Email author
  • Vijay Paul Singh
    • 1
  • Naveen Aggarwal
    • 1
  1. 1.Department of Computer Science and EngineeringUniversity Institute of Engineering and Technology, Panjab UniversityChandigarhIndia

Personalised recommendations