Skip to main content

Advertisement

SpringerLink
Log in

A rough set approach to feature selection based on scatter search metaheuristic

  • Published:
Journal of Systems Science and Complexity Aims and scope Submit manuscript

Abstract

Rough set theory is an effective method to feature selection, which has recently fascinated many researchers. The essence of rough set approach to feature selection is to find a subset of the original features. It is, however, an NP-hard problem finding a minimal subset of the features, and it is necessary to investigate effective and efficient heuristic algorithms. This paper presents a novel rough set approach to feature selection based on scatter search metaheuristic. The proposed method, called scatter search rough set attribute reduction (SSAR), is illustrated by 13 well known datasets from UCI machine learning repository. The proposed heuristic strategy is compared with typical attribute reduction methods including genetic algorithm, ant colony, simulated annealing, and Tabu search. Computational results demonstrate that our algorithm can provide efficient solution to find a minimal subset of the features and show promising and competitive performance on the considered datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Pawlak Z, Rough sets, International Journal of Computer and Information Sciences, 1982, 11: 341–356.

    Article  MATH  MathSciNet  Google Scholar 

  2. Pawlak Z, Rough Sets: Theoretical Aspects of Reasoning About Data, Kluwer Academic Publishers, Boston, 1991.

    Book  MATH  Google Scholar 

  3. Pawlak Z and Skowron A, Rough Set Methods and Applications: New Developments in Knowledge Discovery in Information Systems, Studies in Fuzziness and Soft Computing, Physica-Verlag, Berlin, 2000.

    Google Scholar 

  4. Swiniarski R W and Skowron A, Rough set methods in feature selection and recognition, Pattern Recognition Letters, 2003, 24: 833–849.

    Article  MATH  Google Scholar 

  5. Jensen R and Shen Q, Semantics-preserving dimensionality reduction: Rough and fuzzy-roughbased approaches, IEEE Trans. on Knowledge and Data Engineering, 2004, 16: 1457–1471.

    Article  Google Scholar 

  6. Wong S K M and Ziarko W, On optional decision rules in decision tables, Bull. Polish Acad. Sci., 1985, 33: 693–696.

    MATH  MathSciNet  Google Scholar 

  7. Osman I H and Kelly J P, Meta-Heuristics: Theory and Applications, Kluwer Academic Publishers, Boston, 1996.

    Book  MATH  Google Scholar 

  8. Wro’blewski J, Finding minimal reducts using genetic algorithms, Proc. 2nd Annual Joint Conf. on Information Sciences, Wrightsville Beach, NC, September 28–October 1, 1995, 186–189.

    Google Scholar 

  9. Zhai L Y, Khoo L P, and Fok S C, Feature extraction using rough set theory and genetic algorithms — An application for the simplification of product quality evaluation, Computers and Industrial Engineering, 2002, 43: 661–676.

    Article  Google Scholar 

  10. Ke L J, Feng Z R, and Ren Z G, An efficient ant colony optimization approach to attribute reduction in rough set theory, Pattern Recognition Letters, 2008, 29: 1351–1357.

    Article  Google Scholar 

  11. Hedar A, Wang J, and Fukushima M, Tabu search for attribute reduction in rough set theory, Soft Computing, 2008, 12: 909–918.

    Article  MATH  Google Scholar 

  12. Laguna M and Marti R, Scatter Search: Methodology and Implementations, C. Kluwer Academic Publishers, Boston, 2003.

    Book  Google Scholar 

  13. Rego C and Alidaee B, Metaheursitic Optimization via Memory and Evolution, Springer-Verlag, Berlin, 2005.

    Google Scholar 

  14. Glover F, Heuristics for integer programming using surrogate constraints, Decision Sciences, 1977, 8: 156–166.

    Article  Google Scholar 

  15. Manish S, Rough-fuzzy functions in classification, Fuzzy Sets and Systems, 2002, 132: 353–369.

    Article  MATH  MathSciNet  Google Scholar 

  16. Pal S K, Shankar B U, and Mitra P, Granular computing, rough entropy, and object extraction. Pattern Recognition Letters, 2005, 26(16) 2509–2517.

    Article  Google Scholar 

  17. Liang J Y and Shi Z Z, The information entropy, rough entropy, and knowledge granulation in rough set theory, International Journal of Uncertainty, Fuzziness, and Knowledge-Based Systems, 2004, 12: 56–67.

    Article  MathSciNet  Google Scholar 

  18. Glover F, Surrogate constraints, Operations Research, 1968, 16: 741–749.

    Article  MATH  MathSciNet  Google Scholar 

  19. Glover F, A template for scatter search and path relinking, artificial evolution, Hao J K, Lutton E, Schoenauer M, Snyers D, Lecture Notes in Computer Science 1363, Springer, 1998, 125–137.

    Google Scholar 

  20. Glover F, Laguna M, and Mart R, Scatter search and path relinking: Advances and applications, Glover F, Kochenberger G A, Handbook of Metaheuristics, Kluwer Academic Publishers, Boston, 2003.

    Google Scholar 

  21. Jensen R and Shen Q, Finding rough set reducts with ant colony optimization, Proceedings of the 2003 UK Workshop on Computational Intelligence, 2003, 15–22.

    Google Scholar 

  22. Glover F and Kochenberger G A, Handbook of Metaheuristics, Kluwer Academic Publishers, Boston, 2003.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Center for Forecasting Science, Academy of Mathematics and System Science, Chinese Academy of Science, Beijing, 100190, China

    Jue Wang & Qi Zhang

  2. Department of Computer Science, Faculty of Computers and Information, Assiut University, Assiut, 71516, Egypt

    Hedar Abdel-Rahman & M. Ibrahim Abdel-Monem

Authors
  1. Jue Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qi Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hedar Abdel-Rahman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. M. Ibrahim Abdel-Monem
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Ibrahim Abdel-Monem.

Additional information

This research was supported by the National Natural Science Foundation of China under Grant Nos. 71271202 and 70801058.

This paper was recommended for publication by Editor WANG Shouyang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wang, J., Zhang, Q., Abdel-Rahman, H. et al. A rough set approach to feature selection based on scatter search metaheuristic. J Syst Sci Complex 27, 157–168 (2014). https://doi.org/10.1007/s11424-014-3298-z

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11424-014-3298-z

Keywords

Search

Navigation