Entropic Feature Discrimination Ability for Pattern Classification Based on Neural IAL
Incremental Attribute Learning (IAL) is a novel machine learning strategy, where features are gradually trained in one or more according to some orderings. In IAL, feature ordering is a special preprocessing. Apart from time-consuming contribution-based feature ordering methods, feature ordering also can be derived by filter criteria. In this paper, a novel criterion based on Discriminability, a distribution-based metric, and Entropy is presented to give ranks for feature ordering, which has been validated in both two-category and multivariable classification problems by neural networks. Final experimental results show that the new metric is not only applicable for IAL, but also able to obtain better performance in lower error rates.
Keywordsneural networks incremental attribute learning feature ordering entropy discrimination ability
Unable to display preview. Download preview PDF.
- 3.Chao, S., Wong, F.: An incremental decision tree learning methodology regarding attributes in medical data mining. In: Proc. of the 8th Int’l Conf. on Machine Learning and Cybernetics, Baoding, pp. 1694–1699 (2009)Google Scholar
- 11.Wang, T., Guan, S.U., Liu, F.: Ordered Incremental Attribute Learning based on mRMR and Neural Networks. International Journal of Design, Analysis and Tools for Integrated Circuits and Systems 2(2), 86–90 (2011)Google Scholar