An Enhanced Probabilistic Neural Network Approach Applied to Text Classification

  • Patrick Marques Ciarelli
  • Elias Oliveira
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5856)


Text classification is still a quite difficult problem to be dealt with both by the academia and by the industrial areas. On the top of that, the importance of aggregating a set of related amount of text documents is steadily growing in importance these days. The presence of multi-labeled texts and great quantity of classes turn this problem even more challenging. In this article we present an enhanced version of Probabilistic Neural Network using centroids to tackle the multi-label classification problem. We carried out some experiments comparing our proposed classifier against the other well known classifiers in the literature which were specially designed to treat this type of problem. By the achieved results, we observed that our novel approach were superior to the other classifiers and faster than the Probabilistic Neural Network without the use of centroids.


Information Retrieval Probabilistic Neural Network Multi-label Problem 


  1. 1.
    Sebastiani, F.: Machine learning in automated text categorization. ACM Computing Surveys 34(1), 1–47 (2002)CrossRefGoogle Scholar
  2. 2.
    Specht, D.: Probabilistic Neural Networks, Oxford, UK, vol. 3(1), pp. 109–118. Elsevier Science Ltd., Amsterdam (1990)Google Scholar
  3. 3.
    Oliveira, E., Ciarelli, P.M., Badue, C., De Souza, A.F.: A Comparison between a KNN Based Approach and a PNN Algorithm for a Multi-label Classification Problem. In: ISDA 2008: Eighth International Conference on Intelligent Systems Design and Applications, vol. 2, pp. 628–633 (2008)Google Scholar
  4. 4.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley-Interscience, New York (2001)zbMATHGoogle Scholar
  5. 5.
    Baeza-Yates, R., Ribeiro-Neto, B.: Modern Information Retrieval, 1st edn. Addison-Wesley, New York (1998)Google Scholar
  6. 6.
    Zhang, M.-L., Zhou, Z.-H.: MLkNN: A Lazy Learning Approach to Multi-Label Learning. Pattern Recognition 40(1), 2038–2048 (2007)zbMATHCrossRefGoogle Scholar
  7. 7.
    De Comité, F., Gilleron, R., Tommasi, M.: Learning Multi-label Alternating Decision Trees from Texts and Data. LNCS, pp. 35–49. Springer, Heidelberg (2003)Google Scholar
  8. 8.
    Schapire, R.E., Singer, Y.: BoosTexter: A Boosting-based System for Text Categorization. Machine Learning, 135–168 (2000)Google Scholar
  9. 9.
    Elisseeff, A., Weston, J.: Kernel Methods for Multi-labelled Classification and Categorical Regression Problems. In: Advances in Neural Information Processing Systems, pp. 681–687 (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Patrick Marques Ciarelli
    • 1
  • Elias Oliveira
    • 1
  1. 1.Universidade Federal do Espírito SantoVitóriaBrazil

Personalised recommendations