Locally Balanced Incremental Hierarchical Discriminant Regression

  • Xiao Huang
  • Juyang Weng
  • Roger Calantone
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2690)


Incremental hierarchical discriminant regression faces several challenging issues: (a) a large input space with a small output space and (b) nonstationary statistics of data sequences. In the first case (a), there maybe few distinct labels in the output space while the input data distribute in a high dimensional space. In the second case (b), a tree has to be grown when only a limited data sequence has been observed. In this paper, we present the Locally Balanced Incremental Hierarchical Discriminant Regression (LBIHDR) algorithm. A novel node self-organization and spawning strategy is proposed to generate a more discriminant subspace by forming multiple clusters for one class. The algorithm was successfully applied to different kinds of data set.


Linear Discriminant Analysis Face Image Regression Tree Input Space Output Space 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Breiman, L., Friedman, J., Olshen, R., Stone, C.: Classification and Regression Trees. Chapman & Hall, NewYork (1993)Google Scholar
  2. 2.
    Duda, R., Hart, P., Stork, D.: Pattern Classification. Wiley, NewYork (2001)zbMATHGoogle Scholar
  3. 3.
    Hwang, W., Weng, J.: Hierarchical discriminant regression. IEEE Trans. Pattern Analysis and Machine Intelligence 22(11), 1277–1293 (2000)CrossRefGoogle Scholar
  4. 4.
    Hwang, W., Weng, J.: Incremental hierarchical discriminant regression for indoor visual navigation. In: Int’l Conf. on Image Processing, Thessaloniki, Greece (October 2001)Google Scholar
  5. 5.
    Murthy, S.: Automatic construction of decision trees from data: A multidisciplinary survey. Data Mining and Knowledge Discovery (1998)Google Scholar
  6. 6.
    Murthy, S., Kasit, S., Salzberg, S.: A system for induction of oblique decision trees. Journal of Artificial Intelligence 2, 1–33 (1994)zbMATHGoogle Scholar
  7. 7.
    Phillips, P., Moon, H., Rizvi, S., Rauss, P.: The FERET evaluation methodology for facerecognition algorithms. pami 22, 1090–1103 (2000)Google Scholar
  8. 8.
    Quinlan, J.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo (1993)Google Scholar
  9. 9.
    Roger, R., Benedetto, D., Schmidt, J.: Using the analytic hiearchy process in new product screening. The jouranl of Product Innovation Management 16(1), 65–76 (1999)CrossRefGoogle Scholar
  10. 10.
    Swets, D.L., Weng, J.: Hierarchical discriminant analysis for image retreival. IEEE Trans. Pattern Analysis and Machine Intelligence (1997) (under 2nd-round review)Google Scholar
  11. 11.
    Weng, J., Hwang, W.: An incremental learning algorithm with automatically derived discriminating features. In: Asian Conference on Computer Vision, Taipei, Taiwan, pp. 426–431 (January 2000)Google Scholar
  12. 12.
    Weng, J., McClelland, J., Pentland, A., Sporns, O., StockMan, I., Sur, M., Thelen, E.: Autonomous mental development by robots and animals. Science 291, 599–600 (2000)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Xiao Huang
    • 1
  • Juyang Weng
    • 1
  • Roger Calantone
    • 2
  1. 1.Department of Computer Science and EngineeringMichigan State UniversityEast LansingUSA
  2. 2.The Eli Broad College of BusinessMichigan State UniversityEast LansingUSA

Personalised recommendations