Abstract
The classification of a set of objects into predefined homogenous groups is a problem with major practical interest in many fields. Over the past two decades several non-parametric approaches have been developed to address the classification problem, originating from several scientific fields. This paper is focused on a rule induction approach based on the rough sets theory and the investigation of its performance as opposed to traditional multivariate statistical classification procedures, namely the linear discriminant analysis, the quadratic discriminant analysis and the logit analysis. For this purpose an extensive Monte Carlo simulation is conducted to examine the performance of these methods under different data conditions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Anderson, T. W. (1958): An Introduction to Multivariate Statistical Analysis. Wiley
Bajgier, S. M., hill, A. V. (1982): An Experimental Comparison of Statistical and Linear Programming Approaches to the Discriminant Problem. Decision Sciences 13, 601–618
Brennan, L., Friedman, J. H., Olsen, R. A., Stone, C.J. (1981): Classification and Regression ‘Frees. Pacific Grove
Clark, P., Niblett, T. (1989): The CN2 Induction Algorithm. Machine Learning, Vol. 3, 261–283
Clarke, W. R, Lachenbruch, P. A, Broffitt, B. (1979): How Non-normality Affects the Quadratic Discriminant Function. Communications in Statistics: Theory and Methods, Vol. 8, No. 13, 1285–1301
Dimitras, A. I., Slowinski, R., Susmaga, R., Zopounidis, C. (1999): Business Failure Prediction Using Rough Sets. European Journal of Operation Research, Vol. 114, 49–66
Doumpos, NI., Zopounidis, C., Pardalos, P. M. (2000): Multicriteria Sorting Methodology: Application to Financial Decision Problems. Parallel Algorithms and Applications, Vol. 15, No. 1–2, 113–129
Freed, N., Glover, F. (1981): Simple But Powerful Goal Programming Models for Discriminant Problems. European Journal of Operational Research, Vol. 7, 44–60
Greco, S., Matarazzo, B., Slowinski, R. (1997): Rough Set Approach to Multiattribute Choice and Ranking Problems. in: Fandel, G., Gal, T. (Eds.), Multiple Criteria Decision Making. Springer-Verlag, 318–329
Greco, S., Matarazzo, H., Slowinski, R. (1998): A New Rough Set Approach to Evaluation of Bankruptcy Risk. In: Zopounidis, C. (Ed.), Operational Toole in the Management of Financial Risks. Kluwer Academic Publishers, 121–136
Greco, S., Matarazzo, B., Slowinski, R. (1998): The Use of Rough Sets and Fuzzy Sets in MCDM. In: Gal, T., Hanne, T., Stewart, T. (Eds.), Advances in Multiple Criteria Decision Making. Kluwer Academic Publishers, 14.1–14. 59
Greco, S., Matarazzo, B., Slowinski, R. (1998): Extension of the Rough Set Approach to i’Iitlticriteria Decision Support. INI’OR, Vol. 38, No. 3, 161–196
Greco, S., Mat arazzo, B., Slowinski, R. (2001): Rough Sets’11ory for Nlulticriteria Decision Analysis. European Journal of Operational Research, Vol. 129, No. 3, 1–47
Grzymala-Busse, J. W. (1992): LER.S - A system for Learning from Examples Based on Rough Sets. In: Slowinski, R. (Ed.), Intelligent Decision Support,: Handbook of Applications and Advances of the Rough Sets Theory. Kluwer Academic Publishers, 3 18
Grzymala-Busse, J. W., Stefanowski, J. (2001): Thee Discretizal.ion Methods for Rule Induction. International Journal of Intelligent Systems, Vol. 16, 29–38
Joachimst haler, E. A., Stain, A. (1988): Four Approaches t,o the (’lassification Problem in Discriminant: Analysis: An Experimental Study. Decision Sciences, Vol. 19, 322–333
Komorowski, J., Pawlak Z., Polkowski L., Skowron A. (1999): Rougis Sets: Tutorial. In: Pat, S. K., Skowron, A. (Eds.), Rough Fuzzy Hybridization: A New Trend in Decision-Making. Springer, 3–98
Kordatoff, Y., Michalski, R. S. (1990): Machine Learning: An Artificial Intelligence Approach (Vol. II). Morgan Kaufmann Publishers
Krusinska, E., Slowinski, R., Stefanowski, J. (1992): Discriminant Versus Rough Sets Approach to Vague Data Analysis. Journal Applied Stochastic Models and Data Analysis, Vol. 8, 43–56
Krusinska, F., Stefanowski, J., Stromberg, J. E. (1994): (’omparabilit.y and Usefulness of Newer and Classical Data Analysis Techniques: Application in Medical Domain Classification. In: E. Didey et al. ( ISis. ), New Approaches in Classification and Data Analysis. Springer Verlag, 644–652
Mardia, K. V. (1975): Assessment of Multinormality and the Robustness of Hotelling’s T2 Test. Applied Statistics, Vol. 24, 163–171
Michalski, R. S. (1969): On the Quasi-minimal Solution of the General Covering Problem. Proceedings of the 5th International Federation on Automatic Control, Vol. 27, 109–129
Mienko, R., Stefanowski, J., Toumi, K., Vanderpooten, D. (1996): Discovery Oriented Induction of Decision Rules. Cahier du LA\ISADE 141, J niversite de Paris Dauphine
Patuwo, E., Hu, M. Y., Hung, M. S. (1993): Two-group Classification using Neural Networks. Decision Sciences, Vol. 24, 825–815
Pawlak, Z. (1982): Rough Sets. International Journal of Information and Computer Sciences, Vol. II, 341–356
Pawlak, Z., Slowinski, R. (1994): Decision Analysis Using Rough Sets. International Transactions in Operational Research, Vol. 1. No. 1. 107–114
Pawlak, Z., Slowinski, R. (1991): Rough Set Approach to Multi-attribute Decision Analysis. European Journal of Operational Research, Vol. 72, 1113–459
Quinlan, J. R. (1986): Induction of Decision Trees. Machine learning, Vol. 1, 81–106
Quinlan, J. R. (199:3): C1.5: Programs for Machine Learning. Morgan Kaufmann Publishers
Skowron, A. (1993): Boolean Reasoning for Decision Rules Generation. In: Komorowski, J., Ras, Z. W. (Eds.), Methodologies for Intelligent Systems (Lecture Notes in Artificial Intelligence Vol. 689). Springer-Verlag, 295–305
Slowinski, R.., Stefanowski. J. (1992): RonghDAS and Rough(lass Software Implementations of the Rough Sets Approach. In: Slowinski, R. (Ed.). Intelligent Decision Support: lfaudbook of Applications and Advances of the Bough Sets Theory. Kluwer Academic lublishers, 445–456
Slowinski, R., Stefanowski, J. (1994): Rough Classification with Valued Closeness Relation. In: E. Diday et al. (Eds.), New Approaches in Classification and Data Analysis. Springer-Verlag, 482–488
Slowinski, R., Zopounidis, C. (1995): Application of the Rough Set Approach to Evaluation of Bankruptcy Risk. International Journal of Intelligent Systems in Accounting, Finance and Management, Vol. 4, 27–41
Slowinski, R., Stefanowski, J., Greco, S., Matarazzo, B. (2000): Rough Sets Processing of Inconsistent; Information. Control and Cybernetics, Vol. 29, No. 1, 379–404
Slowinski, R., Zopounidis, C., Dimitras, A. I. (1997): Prediction of Company Acquisition in Greece by Means of the Rough Set Approach. European Journal of Operational Research, Vol. 100, 1–15
Stefanowski, J. (1992): Rough Sets Theory and Discriminant Methods in an Analysis of Information Systems. Foundations of Computing and Decision Sciences, Vol. 17, No. 2, 81–89
Stefanowski, J. (1995): Using Valued Closeness Relation in Classification Support of New Objects. In: Lin, T. Y., Wildberg, A. M. (Eds.), Soft Computing. Simulation Council Inc., 324–327
Stefanowski, J. (199.8): Rough Set Based Rule Induction Techniques for Classification Problems. Proceedings of the 6th European Congress on Intelligent Techniques and Soft Computing (Vol. 1). Aachen Sept. 7–10, 109–113
Stefanowski, J. (1998): On Rough Set Based Approaches to Induction of Decision Rules. In: Polkowski, L., Skowron, A. (Eds.), Rough Sets in Knowledge Discovery. Physica. Verlag, 500–529
Stefanowski, J., Vanderpoolen, D. (1994): A General Two-stage Approach to Inducing Rules from Examples. In: Ziarko, W. (Ed.), Rough Sets, Fuzzy Sets and Knowledge Discovery. Springer-Verlag, 317–325
Stefanowski, J., Slowinski, R., Nowicki, R. (1992): The Rough Sets Approach to Knowledge Analysis for Classification Support in Technical Diagnostics of Mechanical Objects. In: Belli, F., Radermacher, F. J. (Eds). Industrial V Engineering Applications of Artificial Intelligence and Expert Systems (Lecture Notes in Economics and Mathematical Systems 604). Springer-Verlag, 324–331
Szladow, A. J., Ziarko, W. P. (1992): Knowledge-based Process Control Using Rough Sets. In: Slowinski, R., (Ed.), Intelligent Decision Support: Handbook of Applications and Advances of the Rough Sets Theory. Kluwer Academic Publishers, 49–60
Teghem, J., Benjelloun, M. (1992): Some Experiments to Compare Rough Sets Theory and Ordinal Statistical Methods. in: R. Slowinski (lid.), Intelligent Decision Support: Handbook of Applications and Advances of the Rough Sets Theory. Kluwer Academic Publishers, 267–286
Tsumoto, S. (1998): Automated Extraction of Medical Expert System Rules from Clinical Databases Based on Rough Set Theory. Information Sciences; Vol. 112, 67–84
Vale, D. C., Maurelli, V. A. (1983): Simulating Multivariate Nonnorrnal Distributions. Psychometrika, Vol. 48, No. 3, 465–471
Yandell, B. S. (1977): Practical Data Analysis for Designed Experiments. Chapman V Hall
Ziarko, W., Golan, D., Edwards, D. (1993): An application of DATALOGIC/R. Knowledge Discovery Tool to Identify Strong Predictive Rules in Stock Market Data. In: Proceedings of the AAA I Workshop on Knowledge Discovery in Databases, Washington D.C., 89–101
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Doumpos, M., Zopounidis, C. (2004). Rough Sets Theory and Multivariate Data Analysis in Classification Problems: a Simulation Study. In: Chen, SH., Wang, P.P. (eds) Computational Intelligence in Economics and Finance. Advanced Information Processing. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-06373-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-662-06373-6_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-07902-3
Online ISBN: 978-3-662-06373-6
eBook Packages: Springer Book Archive