Abstract
This paper presents the problem of building the sequential model of the classification task. In our approach the structure of the model is built in the learning phase of classification. In this paper a split criterion based on the broken stick model is proposed. The broken stick distribution is created for each column of the confusion matrix. The split criterion is associated with the analysis of the received distributions. The obtained results were verified on ten data sets. Nine data sets come from UCI repository and one is a real-life data set.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kolakowska, A., Malina, W.: Fisher Sequential Classifiers. IEEE Transaction on Systems, Man, and Cybernecics – Part B Cybernecics 35(5), 988–998 (2005)
Mitchell, T.M.: Machine Learning. McGraw-Hill Comp., Inc., New York (1997)
Podolak, I.T.: Hierarchical classifier with overlapping class groups. Expert Syst. Appl. 34(1), 673–682 (2008)
Safavian, S.R., Landgrebe, D.: A survey of decision tree classifier methodology. IEEE Trans. Systems, Man Cyber. 21(3), 660–674 (1991)
Burduk, R.: Classification error in Bayes multistage recognition task with fuzzy observations. Pattern Analysis and Applications 13(1), 85–91 (2010)
Cyganek, B.: Image Segmentation with a Hybrid Ensemble of One-Class Support Vector Machines. In: Graña Romay, M., Corchado, E., Garcia Sebastian, M.T. (eds.) HAIS 2010, Part I. LNCS, vol. 6076, pp. 254–261. Springer, Heidelberg (2010)
Wozniak, M., Grana, M., Corchado, E.: A survey of multiple classifier systems as hybrid systems. Information Fusion (2013), doi: http://dx.doi.org/10.1016/j.inffus.2013.04.006
Kurzyński, M.: Decision Rules for a Hierarchical Classifier. Pat. Rec. Let. 1, 305–310 (1983)
Wozniak, M.: A hybrid decision tree training method using data streams. Knowledge and Information Systems 29(2), 335–347 (2010)
Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. The Journal of Machine Learning Research 3, 1157–1182 (2003)
Rejer, I.: Genetic Algorithms in EEG Feature Selection for the Classification of Movements of the Left and Right Hand. In: Burduk, R., Jackowski, K., Kurzynski, M., Wozniak, M., Zolnierek, A. (eds.) CORES 2013. AISC, vol. 226, pp. 579–589. Springer, Heidelberg (2013)
Penar, W., Woźniak, M.: Experiments on classifiers obtained via decision tree induction methods with different attribute acquisition cost limit. Advances in Soft Computing 45, 371–377 (2007)
Quinlan, J.R.: Induction on Decision Tree. Machine Learning 1, 81–106 (1986)
Manwani, N., Sastry, P.S.: Geometric decision tree. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 42(1), 181–192 (2012)
Quinlan, R.J.: C4.5: Programs for Machine Learning. Machine Learning 16(3), 235–240 (1993)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. John Wiley and Sons (2000)
Macarthur, R.: On the relative abundance of bird species. Proc. Natl. Acad. Sci. USA 43, 293–295 (1957)
King, C.E.: Relative Abundance of Species and MacArthur’s Model. Ecology 45(4), 716–727 (1964)
De Vita, J.: Niche Separation and the Broken-Stick Model. The American Naturalist 114(2), 171–178 (1979)
Leonov, H., Mitchell, J.S., Arkin, I.T.: Monte Carlo Estimation of the Number of Possible Protein Folds: Effects of Sampling Bias and Folds Distributions. Proteins 51, 352–359 (2003)
Yoshiaki, I., Sumie, U., Sumie, H.: The broken-stick model for amino acid composition in proteins. Journal of Molecular Evolution 16(1), 69–72 (1980)
Frontier, S.: Etude de la decroissance des valeurs propres dans une analyse en composantes principales: comparaison avec le modele du baton brise. Biol. Ecol. 25, 67–75 (1976)
Cangelosi, R., Goriely, A.: Component retention in principal component analysis with application to cDNA microarray data. Biol. Direct 2(2) (2007)
Kurzyński, M.: On the Multistage Bayes Classifier. Pattern Recognition 21, 355–365 (1988)
Berger, J.: Statistical Decision Theory and Bayesian Analysis. Springer, New York (1993)
Asuncion, A., Newman, D.J.: UCI machine learning repository (2007)
Burduk, R., Woźniak, M.: Different decision tree induction strategies for a medical decision problem. Central European Journal of Medicine 7(2), 183–193 (2012)
Kurzyński, M.: Diagnosis of acute abdominal pain using three-stage classifier. Computers in Biology and Medicine 17(1), 19–27 (1987)
Dunn, O.J.: Multiple Comparisons Among Means. Journal of the American Statistical Association 56, 52–64 (1961)
Derrac, J., Garciya, S., Molina, D., Herrera, F.: A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm and Evolutionary Computation 1(1), 3–18 (2011)
Bobrowski, L., Topczewska, M.: Separable Linearization of Learning Sets by Ranked Layer of Radial Binary Classifiers. In: Burduk, R., Jackowski, K., Kurzynski, M., Wozniak, M., Zolnierek, A. (eds.) CORES 2013. AISC, vol. 226, pp. 135–144. Springer, Heidelberg (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Burduk, R., Trajdos, P. (2013). Construction of Sequential Classifier Based on Broken Stick Model. In: Pan, JS., Polycarpou, M.M., Woźniak, M., de Carvalho, A.C.P.L.F., Quintián, H., Corchado, E. (eds) Hybrid Artificial Intelligent Systems. HAIS 2013. Lecture Notes in Computer Science(), vol 8073. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40846-5_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-40846-5_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40845-8
Online ISBN: 978-3-642-40846-5
eBook Packages: Computer ScienceComputer Science (R0)