Advertisement

MR-TP-QFPSO: map reduce two phases quantum fuzzy PSO for feature selection

  • Shikha Agarwal
  • Prabhat Ranjan
Original Article
  • 63 Downloads

Abstract

Feature selection is the utmost requirement to deal with high dimensional datasets. Fuzzy logic and particle swarm optimization are the two very popular soft computing methods which have used for feature selection. In this paper different variants of PSO are summarized to explore the latest development in PSO. The survey has been grouped in three categories; structures based PSO variants, fuzzy logic-PSO hybrids and parallel PSO variants. On the basis of findings of survey, map reduce two phases quantum behaved fuzzy rule PSO (MR-TP-QFPSO) method has been proposed. Quantum is the smallest possible state of any matter. Therefore, in proposed method smallest state of any particle is trit, which is having three values 0, 1 and #. # is included to bring a state of uncertainty where, feature is considered neither accepted nor rejected. In first phase search, feature space is exhaustively explored. During exhaustive initial search (first phase), multiple subsets of features are selected using quantum behaved fuzzy rule PSO (QFPSO). From these multiple subsets, minimum most important features (lower bound features) and maximum range of selected features are selected (upper bound feature subset). In second phase, selected feature subspace (selected in first phase) has been exploited and finally merged with lower bound features. The entire two phases search is highly iterative and it is well known that map reduce frame work can accelerate any iterative task by parallel processing. Therefore, proposed two phases QFPSO (TP-QFPSO) is applied using map reduce (MR-TP-QFPSO). The analysis of proposed algorithm clearly shows that map reduce has decreased the processing time of serial TP-QFPSO algorithm. The MR-TP-QFPSO is compared with other feature selection methods. The results on bench marking datasets show that MR-TP-QFRPSO outperformed the other methods. The reduction in execution time is directly propositional to the number of cluster nodes used. Therefore, as number of nodes is increased execution time will decrease without affecting the performance.

Keywords

Big data Map reduce Fuzzy logic Particle swarm optimization Feature selection 

Notes

Acknowledgements

This work is supported by the SRF grant from Council of Scientific & Industrial Research (CSIR), India, SRF Grant (09/1144(0001)2015EMR-I) and Department of Computer Science, Central University of South Bihar.

References

  1. Agarwal S, Ranjan P (2016) Dimensionality reduction methods classical and recent trends: a survey. IJCTA 9(10):4801–4808Google Scholar
  2. Agarwal S, Rajesh R, Ranjan P (2015) Enhanced velocity BPSO and convergence analysis on dimensionality reduction. In: recent advances in mathmatics, statistics and computer science, World Scientific, ISBN 978-981-4704-84-7Google Scholar
  3. Agarwal S, Rajesh R, Ranjan P (2017) FRBPSO: a fuzzy rule based binary PSO for feature selection. Proc Natl Acad Sci India Sect A Phys Sci 87(2):221–233CrossRefGoogle Scholar
  4. Aljarah I, Ludwig SA (2012) Parallel particle swarm optimization clustering algorithm based on map reduce methodology. In: NaBIC: IEEE Fouth World Congress, pp 104–111Google Scholar
  5. Allias N, Megat MN, Ismail MN (2014) A hybrid Gini PSO-SVM feature selection based on taguchi method: an evalution on email filtering. IMCOM(ICUIMC), ACM, ISBN 978-1-4503-2644-5Google Scholar
  6. Bousbaci A, Kamel N (2014) A parallel sampling-pso-multi-core-k-means algorithm using mapreduce. In: 2014 14th International Conference on Hybrid Intelligent Systems (HIS). IEEE, pp 129–134Google Scholar
  7. Cao J, Cui H, Shi H, Jiao L (2016) Big data: a parallel particle swarm optimization-back-propagation neural network algorithm based on mapreduce. Plos One.  https://doi.org/10.1371/journal.pone.0157551 Google Scholar
  8. Chai R, Ling SH, Hunter GP, Tran Y, Nguyen HT (2014) Brain computer interface classifier for wheelchair commands using neural network With fuzzy particle swarm optimization. IEEE J Biomed Health Inf 18:1614–1624CrossRefGoogle Scholar
  9. Chang JC (2016) Modified particle swarm optimization for solving travelling salesman problem based on a Hadoop MapReduce Framework. In: ICASI, pp 26–30. doi:  10.1109/ICASI.2016.7539772
  10. Chuang LY, Chang HW, Tu CJ, Yang CH (2008) Improved binary PSO for feature selection using gene expression data. Comput Biol Chem 32:29–38CrossRefzbMATHGoogle Scholar
  11. Chuang LY, Tsai SW, Yang CH (2011) Improved binary particle swarm optimization using catfish effect for feature selection. Expert Syst Appl 38(10):12699–12707CrossRefGoogle Scholar
  12. Chuang LY, Tsai SW, Yang CH (2012) Fuzzy adaptive catfish particle swarm optimization. Artif Intell Res 1:149–170CrossRefGoogle Scholar
  13. Chunne AP, Chandrasekhar U, Malhotra C (2015) Real time clustering of tweets using adaptive PSO technique and MapReduce. In: GCCT. doi I:  10.1109/GCCT.2015.7342704, IEEE
  14. Dinh P, Thanh TN, Xuan TT (2014) A Hybrid Multi-objective PSO-SA algorithm for the fuzzy rule based classifier design problem with the order based semantics of linguistic terms. VNU J Sci Comp Sci Com Eng 30:44–56Google Scholar
  15. Ganguly S, Sahoo NC, Das D (2013) Multi-objective particle swarm optimization based on fuzzy-Pareto-dominance for possibilistic planning of electrical distribution system incorporating distributed generation. Fuzzy Set Syst 213:47–73MathSciNetCrossRefGoogle Scholar
  16. Izakian H, Abraham A, Snasel V (2009) Fuzzy clustering using hybrid fuzzy c means and fuzzy particle swarm optimization. In: Proceedings of the world congress on nature & biologically inspired computing (NaBIC), pp 1690–1694Google Scholar
  17. Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: IEEE international conference on neural networks. Perth, Australia, pp 1942–1948Google Scholar
  18. Kennedy J, Eberhart RC (1997) A discrete binary version of the particle swarm algorithm. In: IEEE conference on systems, man, and cyber, pp 4104–4108Google Scholar
  19. Kourid A (2014) Interative map reduce for feature selection. In: IJERT, pp 1788–1793Google Scholar
  20. Li Y, Chen Z, Wang Y, Jiao L (2016) Quantum-behaved particle swarm optimization using mapreduce bioinspired computing theories and application. Springer, Berlin, p 1410–1430Google Scholar
  21. Lin SW, Ying KC, Chen SC, Lee ZJ (2008) Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Syst Appl 35(4):1817–1824CrossRefGoogle Scholar
  22. Lin JW, Chi WC, Chang RI (2017) Particle swarm optimization combined with querybased learning using mapreduce. future information technology. Lect Note Electr Eng 309:91–97CrossRefGoogle Scholar
  23. Liu H, Abraham A, Zhang W (2007) Fuzzy adaptive turbulent particle swarm optimization. Int J Innov Comput Appl (IJICA) 1:39–47CrossRefGoogle Scholar
  24. Ludwig SA (2014) Map reduce-based optimization of overlay networks using particle swarm optimization. In: GECCO’14, pp 1031–1038Google Scholar
  25. Ludwig SW, Aljarah I (2016) A scalable map reduce enabled glow worm swarm optimization approach for high dimensional multimodal functions. Int J Swarm Intell Res 7(1):32–54CrossRefGoogle Scholar
  26. McNabb AW, Monson CK and Seppi KD (2007) Parallel PSO using mapreduce. In: CEC 27: Proceedings of the IEEE Congress on Evolutionary Computation, pp 7–14Google Scholar
  27. Mehrjoo S, Dehghanian S (2015) Map reduce based particle swarm optimization for large scale problems. In: AICS 2015: Proceeding of the 3rd International Conference on Artificial Intelligence and Computer Science, pp 12–13Google Scholar
  28. Olivas F, Valdez F, Castillo O (2015) Fuzzy classification system design using PSO with dynamic parameter adaptation through fuzzy logic. Fuzzy Log Augment Nat Inspir Optim Metaheuristics Stud Comput Intell 574:29–47Google Scholar
  29. Pan H, Zhu YP, Xia L (2013) Fusing multi-feature representation and PSO-Adaboost based feature selection for reliable frontal face detection. In: Proceedings of the IEEE symposium on swarm Intelligence, pp 2998–3002Google Scholar
  30. Rajesh R, Agarwal S (2014) Some modification in particle swarm optimization. In: the 18th Online World Conference on Soft Computing in Industrial ApplicationsGoogle Scholar
  31. Sadasivam GS, Selvaraj D (2011) A novel parallel hybrid PSOGA using Map Reduce to schedule jobs in Hadoop data grids. In: NaBIC: Second World Congres, IEEE. doi:  10.1109/NABIC.2010.5716346
  32. Shi YH, Eberhart RC (2001) Fuzzy adaptive particle swarm optimization. In: Proceedings of the IEEE congress on evolutionary computation, pp 101–106Google Scholar
  33. Soeprijanto A, Abdillah M (2011) Type 2 fuzzy adaptive binary particle swarm optimization for optimal placement and sizing of distributed generation. In: Proceedings of the 2nd international conference on instrumentation, communications, information technology, and biomedical engineering (ICICIBME), IEEE, pp 233–238Google Scholar
  34. Sun J, Feng B, Xu W (2004) Particle swarm optimization with particle having quantum behaviour. In: Proceedings of the IEEE congress on evolutionary computation, pp 325–331Google Scholar
  35. Torabi SA, Sahebjamnia N, Mansouri SA, Bajestani MA (2013) A particle swarm optimization for a fuzzy multi-objective unrelated parallel machine scheduling problem. Appl Soft Comput 13:4750–4762CrossRefGoogle Scholar
  36. Vieira SM, Mendonca LF, Farinha GJ, Sousa JMC (2013) Modified binary PSO for feature selection using SVM applied to mortality prediction of septic patients. Appl Soft Comput 13:3494–3504CrossRefGoogle Scholar
  37. Wai ENC, Tsai PW, Pan JS (2016) Hierarchical PSO clustering on mapreduce for scalable privacy preservation in big data. Genet Evolut Comput Ser Adv Intell Syst Comput 536:36–44CrossRefGoogle Scholar
  38. Wang J, Yuan D, Jiang M (2012) Parallel K-PSO based on map reduce. IEEE explorer, pp 1203–1208Google Scholar
  39. Wang F, Yu PLH, Chung WD (2014) Combining technical trading rules using parallel particle swarm optimization based on Hadoop. In: IJCNN. doi:  10.1109/IJCNN.2014.6889599
  40. Wang Y, Li Y, Chen Z, Xue X (2016) Cooperative particle swarm optimization using Map reduce. Soft computing.  https://doi.org/10.1007/s00500-016-2390-9 Google Scholar
  41. Xu J, Tang Y (2015) Improved particle optimization algorithm solving hadoop task scheduling problem. In: ICICCI, pp 11–14Google Scholar
  42. Xua Y, You T (2013) Minimizing thermal residual stresses in ceramic matrix composites by using Iterative MapReduce guided particle swarm optimization algorithm. Compos Struct 99:388–396CrossRefGoogle Scholar
  43. Xue B, Zhang M, Browne WN (2014) Particle swarm optimization for feature selection in classification: novel initialisation and updating mechanisms. Appl Soft Comput 18:261–276.  https://doi.org/10.1016/j.asoc.2013.09.018 CrossRefGoogle Scholar
  44. Yang S, Wang M, Jiao L (2004) A quantum particle swarm optimization. In: Proceedings of the IEEE congress on evolutionary computation, pp 320–324Google Scholar

Copyright information

© The Society for Reliability Engineering, Quality and Operations Management (SREQOM), India and The Division of Operation and Maintenance, Lulea University of Technology, Sweden 2017

Authors and Affiliations

  1. 1.Department of Computer ScienceCentral University of South Bihar, CUSBPatnaIndia

Personalised recommendations