Abstract
We compare two diverse classification strategies on real-life biomedical data. One is based on a genetic algorithm-driven feature extraction method, combined with data fusion and the use of a simple, single classifier, such as linear discriminant analysis. The other exploits a single layer perceptron-based, data-driven evolution of the optimal classifier, and data fusion. We discuss the intricate interplay between dataset size, the number of features, and classifier complexity, and suggest different techniques to handle such problems.
Chapter PDF
Similar content being viewed by others
Keywords
- Linear Discriminant Analysis
- Fusion Rule
- Classifier Fusion
- Classification Methodology
- Multiple Classifier System
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Kittler J., Roli F. (eds): Multiple Classifier Systems. Springer Lecture Notes in Computer Science, Springer Vol. 1857 (2000), Vol. 2096 (2001)
Ho T.K.: Data complexity analysis for classifier combination. In: Multiple Classifier Systems. J. Kittler and F. Roli (eds). Springer Lecture Notes in Computer Science, Springer Vol. 2096, (2001), 53–67
Raudys S.: Evolution and generalization of a single neuron. I. SLP as seven statistical classifiers. Neural Networks 11, 1998, 283–96
Raudys S.: Statistical and Neural Classifiers: An integrated approach to design. Springer, London, (2001) 312
Pivoriunas V.: The linear discriminant function for the identification of spectra. In: S Raudys (editor), Statistical Problems of Control 27, (1978), 71–90. Institute of Mathematics and Informatics, Vilnius (in Russian)
Skurichina M., Raudys S., Duin R.P.W.: K-nearest neighbours directed noise injection in multilayer perceptron training. IEEE Trans. On Neural Networks. 11(2) (2000), 504–511
Janeliūnas A.: Bias correction of linear classifiers in the classifier combination scheme. In: Proceedings of the 2nd International Conference on Neural Networks and Artificial Intelligence, BSUIR, Minsk, (2001) 91–98
Nikulin A., Dolenko B., Bezabeh T., Somorjai R.: Near-optimal region selection for feature space reduction: novel preprocessing methods for classifying MR spectra. NMR in Biomedicine, 11 (1998) 209–216
Mountford C, Somorjai R., Gluch L., Malycha P., Lean C, Russell P., Bilous M., Barraclough B., Gillett D., Himmelreich U., Dolenko B., Nikulin A., Smith I.: MRS on breast fine needle aspirate biopsy determines pathology, vascularization and nodal involvement. Br. J. Surg. 88 (2001) 1234–1240
Somorjai R.L., Dolenko B., Nikulin A., Nickerson P., Rush D., Shaw A., de Glogowski M., Rendell J., Deslauriers R. (2002) Distinguishing normal allografts from biopsy-proven rejections: application of a three-stage classification strategy to urine MR and IR spectra. Vibrational Spectroscopy 28:(1) 97–102
Zhilkin P., Somorjai R.: Application of several methods of classification fusion to magnetic resonance spectra. Connection Science 8(3) (1996) 427–442
Jain A.K., Duin R.P.W., Mao J.: Statistical pattern recognition: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 (2000) 4–37
Somorjai R.L., Nikulin A.E., Pizzi N., Jackson D., Scarth G., Dolenko B., Gordon H., Russell P., Lean C.L., Delbridge L., Mountford C.E., Smith I.C.P.: Computerized consensus diagnosis: a classification strategy for the robust analysis of MR spectra. I. Application to 1H spectra of thyroid neoplasms. Magn. Reson. Med. 33 (1995) 257–263
Somorjai R.L., Dolenko B., Nikulin A.E., Pizzi N., Scarth G., Zhilkin P., Halliday W., Fewer J., Hill N., Ross I., West M., Smith I., Donnelly M., Kuesel A., Brière K.: Classification of 1H MR spectra of human brain biopsies: The influence of preprocessing and computerized consensus diagnosis on classification accuracy. J Magn Reson Imaging 6 (1996) 437–444
Efron B., Tibshirani R.: An Introduction to the Bootstrap. Monographs on Statistics and Applied Probability, Cox D., Hinkley D., Reid N., Rubin D. and Silverman B.W. (General Eds.) Vol. 57 Chapman & Hall, London (1993)
Cohen J.: Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin 70 (1968) 213–220
Wolpert D.H.: Stacked generalization. Neural Networks 5 (1992) 241–259
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Somorjai, R., Janeliunas, A., Baumgartner, R., Raudys, S. (2002). Comparison of Two Classification Methodologies on a Real-World Biomedical Problem. In: Caelli, T., Amin, A., Duin, R.P.W., de Ridder, D., Kamel, M. (eds) Structural, Syntactic, and Statistical Pattern Recognition. SSPR /SPR 2002. Lecture Notes in Computer Science, vol 2396. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-70659-3_45
Download citation
DOI: https://doi.org/10.1007/3-540-70659-3_45
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44011-6
Online ISBN: 978-3-540-70659-5
eBook Packages: Springer Book Archive