Hierarchical Intelligent Classification Systems

  • Andrey V. Savchenko
Part of the SpringerBriefs in Optimization book series (BRIEFSOPTI)


This chapter is focused on the insufficient performance of the hierarchical classifiers. The theory of granular computing and the mathematical model of the piecewise-regular object from Chap. 2 are used to define the hierarchical levels. The sequence with a small number of the weakly homogeneous segments is considered as a coarse-grained granule. Fine-grained granules stand for a large number of high-homogeneous small segments. We apply sequential three-way decisions (TWD) to speed-up the classification procedure. To improve the classification performance at each granularity level, the probabilistic rough set of the distance between objects from different classes at each level is created. If the distance between an observed object and the next checked instance is included in its negative region, the search procedure is terminated. Experimental results demonstrated that sequential TWD significantly decreases the classification time in comparison with the matching of the pyramid histograms of oriented gradients.


  1. [1]
    Bosch, A., Zisserman, A., Munoz, X.: Representing shape with a spatial pyramid kernel. In: Proceedings of the 6th ACM International Conference on Image and Video Retrieval (CIVR), pp. 401–408. New York, USA (2007)Google Scholar
  2. [2]
    Chow, C.: On optimum recognition error and reject tradeoff. IEEE Trans. Inf. Theory 16(1), 41–46 (1970)CrossRefzbMATHGoogle Scholar
  3. [3]
    Ciresan, D., Meier, U., Masci, J., Schmidhuber, J.: Multi-column deep neural network for traffic sign classification. Neural Netw 32, 333–338 (2012)CrossRefGoogle Scholar
  4. [4]
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 886–893 (2005)Google Scholar
  5. [5]
    Dou, H., Yang, X., Fan, J., Xu, S.: The models of variable precision multigranulation rough sets. In: Li, T., Nguyen, H.S., Wang, G., Grzymala-Busse, J., Janicki, R., Hassanien, A.E., Yu, H. (eds.) Proceedings of the International Conference on Rough Sets and Knowledge Technology, LNCS, vol. 7414, pp. 465–473. Springer-Verlag Berlin Heidelberg (2012)CrossRefGoogle Scholar
  6. [6]
    Hawkins, J., Blakeslee, S.: On Intelligence.St. Martin’s Griffin, New York (2005)Google Scholar
  7. [7]
    Huang, P.X., Boom, B.J., Fisher, R.B.: Hierarchical classification with reject option for live fish recognition. Mach. Vis. Appl. 26(1), 89–102 (2015)CrossRefGoogle Scholar
  8. [8]
    Li, H., Zhang, L., Huang, B., Zhou, X.: Sequential three-way decision and granulation for cost-sensitive face recognition. Knowl.-Based Syst. 91, 241–251 (2016)CrossRefGoogle Scholar
  9. [9]
    Pawlak, Z.: Rough Sets: Theoretical Aspects of Reasoning About Data. Kluwer Academic Publishers, Norwell (1992)zbMATHGoogle Scholar
  10. [10]
    Pedrycz, W.: Granular Computing: Analysis and Design of Intelligent Systems. CRC Press, Boca Raton (2013)CrossRefGoogle Scholar
  11. [11]
    Pedrycz, W., Succi, G., Sillitti, A., Iljazi, J.: Data description: A general framework of information granules. Knowl.-Based Syst. 80, 98–108 (2015)CrossRefGoogle Scholar
  12. [12]
    Savchenko, A.V.: Real-time image recognition with the parallel directed enumeration method. In: Chen, M., Leibe, B., Neumann, B. (eds.) Proceedings of the International Conference on Vision Systems (ICVS), LNCS, vol. 7963, pp. 123–132. Springer-Verlag Berlin Heidelberg (2013)Google Scholar
  13. [13]
    Savchenko, A.V.: Fast multi-class recognition of piecewise regular objects based on sequential three-way decisions and granular computing. Knowl.-Based Syst. 91, 252–262 (2016)CrossRefGoogle Scholar
  14. [14]
    Savchenko, A.V., Milov, V.R., Belova, N.S.: Sequential hierarchical image recognition based on the pyramid histograms of oriented gradients with small samples. In: Khachay, M.Y., Konstantinova, N., Panchenko, A., Ignatov, D.I., Labunets, V.G. (eds.) Proceedings of the International Conference on Analysis of Images, Social Networks and Texts, CCIS, vol. 542, pp. 14–23. Springer International Publishing Switzerland (2015)Google Scholar
  15. [15]
    Shapiro, L.G., Stockman, G.C.: Computer Vision. Prentice Hall, Upper Saddle River (2001)Google Scholar
  16. [16]
    Theodoridis, S., Koutroumbas, K.: Pattern Recognition, 4th edn. Academic, Burlington (2008)zbMATHGoogle Scholar
  17. [17]
    Wald, A.: Sequential Analysis. Dover Publications, New York (2013)zbMATHGoogle Scholar
  18. [18]
    Yao, Y.: Three-way decisions with probabilistic rough sets. Inf. Sci. 180, 341–353 (2010)MathSciNetCrossRefGoogle Scholar
  19. [19]
    Yao, Y.: Granular computing and sequential three-way decisions. In: Lingras, P., Wolski, M., Cornelis, C., Mitra, S., Wasilewski, P. (eds.) Proceedings of the International Conference on Rough Sets and Knowledge Technology (RSKT), LNCS, vol. 8171, pp. 16–27. Springer-Verlag Berlin Heidelberg (2013)CrossRefGoogle Scholar
  20. [20]
    Zadeh, L.A.: Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst. 90(2), 111–127 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  21. [21]
    Ziarko, W.: Probabilistic approach to rough sets. Int. J. Approx. Reason. 49(2), 272–284 (2008)MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© The Author(s) 2016

Authors and Affiliations

  • Andrey V. Savchenko
    • 1
  1. 1.Laboratory of Algorithms and Technologies for Network AnalysisNational Research University Higher School of EconomicsNizhny NovgorodRussia

Personalised recommendations