Fuzzy-Rough MRMS Method for Relevant and Significant Attribute Selection

  • Pradipta Maji
  • Partha Garai
Part of the Communications in Computer and Information Science book series (CCIS, volume 297)


Feature selection refers to the problem of selecting the input attributes or features that are most effective to predict the sample categories. In this regard, a feature selection method is presented based on fuzzy-rough sets by maximizing both relevance and significance of the selected features. The paper also presents different feature evaluation criteria such as dependency, relevance, redundancy and significance for attribute selection task using fuzzy-rough sets. The performance of different rough set models is compared with that of some existing feature evaluation indices based on the predictive accuracy of nearest neighbor rule, support vector machine and decision tree. The effectiveness of fuzzy-rough set based attribute selection method, along with a comparison with existing feature evaluation indices and different rough set models, is demonstrated on two benchmark and two microarray gene expression data sets.


Feature Selection Linear Discriminant Analysis Feature Selection Method Attribute Selection Base Feature Selection Method 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Peng, H., Long, F., Ding, C.: Feature Selection Based on Mutual Information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(8), 1226–1238 (2005)CrossRefGoogle Scholar
  2. 2.
    Maji, P., Paul, S.: Rough Set Based Maximum Relevance-Maximum Significance Criterion and Gene Selection from Microarray Data. International Journal of Approximate Reasoning 52(3), 408–426 (2011)CrossRefGoogle Scholar
  3. 3.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification and Scene Analysis. John Wiley & Sons, Inc., New York (1999)Google Scholar
  4. 4.
    Maji, P., Pal, S.K.: Feature Selection Using f-Information Measures in Fuzzy Approximation Spaces. IEEE Transactions on Knowledge and Data Engineering 22(6), 854–867 (2010)CrossRefGoogle Scholar
  5. 5.
    Pawlak, Z.: Rough Sets: Theoretical Aspects of Resoning About Data. Kluwer, Dordrecht (1991)Google Scholar
  6. 6.
    Chouchoulas, A., Shen, Q.: Rough Set-Aided Keyword Reduction for Text Categorisation. Applied Artificial Intelligence 15(9), 843–873 (2001)CrossRefGoogle Scholar
  7. 7.
    Jensen, R., Shen, Q.: Semantics-Preserving Dimensionality Reduction: Rough and Fuzzy-Rough-Based Approach. IEEE Transactions on Knowledge and Data Engineering 16(12), 1457–1471 (2004)CrossRefGoogle Scholar
  8. 8.
    Dubois, D., Prade, H.: Rough Fuzzy Sets and Fuzzy Rough Sets. International Journal of General Systems 17, 191–209 (1990)CrossRefzbMATHGoogle Scholar
  9. 9.
    Hu, Q., Yu, D., Liu, J., Wu, C.: Neighborhood Rough Set Based Heterogeneous Feature Subset Selection. Information Sciences 178, 3577–3594 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Pal, S.K., Mitra, S.: Neuro-Fuzzy Pattern Recognition: Methods in Soft Computing. John Wiley & Sons, New York (1999)Google Scholar
  11. 11.
    Devijver, P.A., Kittler, J.: Pattern Recognition: A Statistical Approach. Prentice-Hall, Englewood Cliffs (1982)zbMATHGoogle Scholar
  12. 12.
    Davies, D.L., Bouldin, D.W.: A Cluster Separation Measure. IEEE Transactions on Pattern Analysis and Machine Intelligence 1, 224–227 (1979)CrossRefGoogle Scholar
  13. 13.
    Bezdek, J.C., Pal, N.R.: Some New Indexes for Cluster Validity. IEEE Transactions on System, Man, and Cybernetics, Part B: Cybernetics 28, 301–315 (1988)CrossRefGoogle Scholar
  14. 14.
    Pal, S.K., De, R.K., Basak, J.: Unsupervised Feature Evaluation: A Neuro-Fuzzy Approach. IEEE Transactions on Neural Network 11(2), 366–376 (2000)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Pradipta Maji
    • 1
  • Partha Garai
    • 1
  1. 1.Machine Intelligence UnitIndian Statistical InstituteIndia

Personalised recommendations