Abstract
This paper presents a perspective based model for creating diverse ensemble members in a multi-classifier system. With this technique different input feature sets are constructed using standard digital image processing and analyzing techniques viz. Haralick texture features, Gabor texture features, normalized difference vegetation index, standard deviation, spectral signatures, color spaces - CIELAB, HSV. These features are used as descriptors. Input feature sets are created as many as ensemble members. Input feature sets are discrete in nature because there is no common feature shared between any two input feature sets. Each one of these discrete input feature sets is utilized for training a particular ensemble member only. Each ensemble member would identify the classes independently and with completely different set of features. An empirical study for multi-spectral images shows that diverse and independent ensemble members can be constructed through our proposed technique. Results also show that proposed technique outperforms bagging in terms of individual member diversity and classification accuracy.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Breiman, L.: Bagging predictors. Machine Learning 24(2), 123–140 (1996)
Raviv, Y., Intrator, N.: Bootstrapping with noise: An effective regularization technique. Connection Science 8, 355–372 (1996)
Freund, Y., Schapire, R.E.: Experiments with a new boosting algorithm. In: Proceedings of the 13th International Conference on Machine Learning, pp. 148–156. Morgan Kaufmann (1996)
Guerra-Salcedo, C., Whitley, D.: Genetic Approach for Feature Selection for Ensemble Creation. In: Banzhaf, W., Daida, J., Eiben, A.E., Garzon, M.H., Honavar, V., Jakiela, M., Smith, R.E. (eds.) GECCO 1999: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 236–243. Morgan Kaufmann, San Francisco (1999a)
Opitz, D., Shavlik, J.: Generating accurate and diverse members of a neural-network ensemble. In: Touretzky, D., Mozer, M., Hasselmo, M. (eds.) Advances in Neural Information Processing Systems 8. MIT Press, Cambridge (1996)
Liao, Y., Moody, J.: Constructing heterogeneous committees using input feature grouping. Advances in Neural Information Processing Systems 12, 921–927 (1999)
Oza, N.C., Tumer, K.: Input decimation ensembles: Decorrelation through dimensionality reduction. In: Kittler, J., Roli, F. (eds.) MCS 2001. LNCS, vol. 2096, pp. 238–247. Springer, Heidelberg (2001)
Sharkey, A.J.C., Sharkey, N.E., Gerecke, U., Chandroth, G.O.: The test and select approach to ensemble combination. In: Kittler, J., Roli, F. (eds.) MCS 2000. LNCS, vol. 1857, pp. 30–44. Springer, Heidelberg (2000)
Breiman, L.: Randomizing outputs to increase prediction accuracy, Technical Report 518, Statistics Department, University of California (1998), http://www.boosting.org/papers/Bre98.pdf
Dietterich, T., Bakiri, G., Error-correcting, G.: output codes: a general method for improv-ing multiclass inductive learning programs. In: Dean, T.L., McKeown, K. (eds.) Proceedings of the Ninth AAAI National Conference on Artificial Intelligence, pp. 572–577. AAAI Press, Menlo Park (1991)
Haralick, R., Shanmugam, M., Dinstein, K., Textural, I.: features for image classification. IEEE Transactions on Systems, Man and Cybernetics SMC-3(6), 610–621 (1973)
Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of image data. IEEE Transactions on Pattern analysis and Machine Intelligence 18(8), 837–842 (1996)
Gonzalez, R., Woods, C.: Digital Image Processing, 2nd edn. Prentice Hall, Upper Saddle River 07458 665-667
Jain, A.K., Vailaya, A.: Image Retrieval using color and shape. Pattern Recognition 29(8), 1233–1244 (1996)
Cheng, H.-D., Sun, Y.: A hierarchical Approach to color image segmentation using homogeneity. IEEE Transactions on Image Processing 9(12) (December 2000)
Duin, R.P.W., Tax, D.M.J.: Experiments with classifier combining rules. In: Kittler, J., Roli, F. (eds.) MCS 2000. LNCS, vol. 1857, pp. 16–29. Springer, Heidelberg (2000)
Krogh, A., Vedelsby, J.: Neural network ensembles, cross validation, and active learning. In: Tesauro, G., Touretzky, D., Leen, T. (eds.) Advances in Neural Information Processing Systems, vol. 7. MIT Press, Cambridge (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Eeti, L.N., Buddhiraju, K.M. (2014). Perspective Based Model for Constructing Diverse Ensemble Members in Multi-classifier Systems for Multi-spectral Image Classification. In: Bayro-Corrochano, E., Hancock, E. (eds) Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2014. Lecture Notes in Computer Science, vol 8827. Springer, Cham. https://doi.org/10.1007/978-3-319-12568-8_78
Download citation
DOI: https://doi.org/10.1007/978-3-319-12568-8_78
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-12567-1
Online ISBN: 978-3-319-12568-8
eBook Packages: Computer ScienceComputer Science (R0)