Issues on GPU Parallel Implementation of Evolutionary High-Dimensional Multi-objective Feature Selection

  • Juan José Escobar
  • Julio Ortega
  • Jesús González
  • Miguel Damas
  • Beatriz Prieto
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10199)


The interest on applications that analyse large volumes of high dimensional data has grown recently. Many of these applications related to the so-called Big Data show different implicit parallelism that can benefit from the efficient use, in terms of performance and power consumption, of Graphics Processing Unit (GPU) accelerators. Although the GPU microarchitectures make possible the acceleration of applications by exploiting parallelism at different levels, the characteristics of their memory hierarchy and the location of GPUs as coprocessors require a careful organization of the memory access patterns and data transferences to get efficient speedups. This paper aims to take advantage of heterogeneous parallel codes on GPUs to accelerate evolutionary approaches in Electroencephalogram (EEG) classification and feature selection in the context of Brain Computer Interface (BCI) tasks. The results show the benefits of taking into account not only the data parallelism achievable by GPUs, but also the memory access patterns, in order to increase the speedups achieved by superscalar cores.


EEG classification Feature selection GPU Heterogeneous parallel architectures Multi-objective optimization OpenCL 



This work has been funded by project TIN2015-67020-P (Spanish “Ministerio de Economá y Competitividad” and FEDER funds). We also thank the BCI laboratory of the University of Essex, and especially prof. John Q. Gan, for allowing us to use their databases.


  1. 1.
    Rupp, R., Kleih, S., Leeb, R., Millan, J., Kübler, A., Müller-Putz, G.: Brain-computer interfaces and assistive technology. In: Grübler, G., Hildt, E. (eds.) Brain-Computer-Interfaces in their Ethical, Social and Cultural Contexts. The International Library of Ethics, Law and Technology, pp. 7–38. Springer, Heidelberg (2014)Google Scholar
  2. 2.
    Collet, P.: Why GPGPUs for evolutionary computation? In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs. Natural Computing Series, pp. 3–14. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  3. 3.
    Alba, E., Luque, G., Nesmachnow, S.: Parallel metaheuristics: recent advances and new trends. Int. Trans. Oper. Res. 20(1), 1–48 (2013)CrossRefzbMATHGoogle Scholar
  4. 4.
    Sharma, D., Collet, P.: Implementation techniques for massively parallel multi-objective optimization. In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs. Natural Computing Series, pp. 267–286. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  5. 5.
    Wong, M., Cui, G.: Data mining using parallel multi-objective evolutionary algorithms on graphics processing units. In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs. Natural Computing Series, pp. 287–307. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  6. 6.
    Baramkar, P., Kulkarni, D.: Review for k-means on graphics processing units (GPU). Int. J. Eng. Res. Technol. 3(6), 1911–1914 (2014)Google Scholar
  7. 7.
    Wu, R., Zhang, B., Hsu, M.: Clustering billions of data points using gpus. In: Hast, A., Buchty, R., Tao, J., Weidendorfer, J. (eds.) Proceedings of the Combined Workshops on UnConventional High Performance Computing workshop plus Memory Access Workshop, pp. 1–6. UCHPC-MAW 2009. ACM, Ischia, May 2009Google Scholar
  8. 8.
    Zechner, M., Granitzer, M.: Accelerating k-means on the graphics processor via CUDA. In: Proceedings of the First International Conference on Intensive Applications and Services, INTENSIVE 2009, pp. 7–15. IEEE, Valencia, April 2009Google Scholar
  9. 9.
    Escobar, J.J., Ortega, J., González, J., Damas, M.: Assessing parallel heterogeneous computer architectures for multiobjective feature selection on EEG classification. In: Ortuño, F., Rojas, I. (eds.) IWBBIO 2016. LNCS, vol. 9656, pp. 277–289. Springer, Heidelberg (2016). doi: 10.1007/978-3-319-31744-1_25CrossRefGoogle Scholar
  10. 10.
    Escobar, J.J., Ortega, J., González, J., Damas, M.: Improving memory accesses for heterogeneous parallel multi-objective feature selection on eeg classification. In: Proceedings of the 4th International Workshop on Parallelism in Bioinformatics, PBIO 2016. Springer, Grenoble, France (2016)Google Scholar
  11. 11.
    Khronos Group: Khronos opencl registry. Accessed: 30 November 2015
  12. 12.
    Bellman, R.: Adaptive Control Processes: A Guided Tour. Princeton University Press, Princeton (1961)CrossRefzbMATHGoogle Scholar
  13. 13.
    Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S., Coello Coello, C.: A survey of multiobjective evolutionary algorithms for data mining: Part I. IEEE Trans. Evol. Comput. 18(1), 4–19 (2014)CrossRefGoogle Scholar
  14. 14.
    Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S., Coello Coello, C.: A survey of multiobjective evolutionary algorithms for data mining: Part II. IEEE Trans. Evol. Comput. 18(1), 20–35 (2014)CrossRefGoogle Scholar
  15. 15.
    Handl, J., Knowles, J.: Feature subset selection in unsupervised learning via multiobjective optimization. Int. J. Comput. Intell. Res. 2(3), 217–238 (2006)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Arbelaitz, O., Gurrutxaga, I., Muguerza, J., Pérez, J., Perona, I.: An extensive comparative study of cluster validity indices. Pattern Recogn. 46(1), 243–256 (2013)CrossRefGoogle Scholar
  17. 17.
    Lopez-Novoa, U., Mendiburu, A., Miguel-Alonso, J.: A survey of performance modeling and simulation techniques for accelerator-based computing. IEEE Trans. Parallel Distrib. Syst. 26(1), 272–281 (2015)CrossRefGoogle Scholar
  18. 18.
    Hong, S., Kim, H.: An analytical model for a GPU architecture with memory-level and thread-level parallelism awareness. In: Proceedings of the 36th Annual International Symposium on Computer Architecture, pp. 152–163. ISCA 2009. ACM, New York, June 2009Google Scholar
  19. 19.
    Dao, T., Kim, J., Seo, S., Egger, B., Lee, J.: A performance model for gpus with caches. IEEE Trans. Parallel Distrib. Syst. 26(7), 1800–1813 (2015)CrossRefGoogle Scholar
  20. 20.
    Kimovski, D., Ortega, J., Ortiz, A., Baños, R.: Leveraging cooperation for parallel multi-objective feature selection in high-dimensional eeg data. Concurrency Comput. Pract. Experience 27(18), 5476–5499 (2015)CrossRefGoogle Scholar
  21. 21.
    Fazendeiro, P., Padole, C., Sequeira, P., Prata, P.: OpenCL implementations of a genetic algorithm for feature selection in periocular biometric recognition. In: Panigrahi, B.K., Das, S., Suganthan, P.N., Nanda, P.K. (eds.) SEMCCO 2012. LNCS, vol. 7677, pp. 729–737. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-35380-2_85CrossRefGoogle Scholar
  22. 22.
    Dhanasekaran, B., Rubin, N.: A new method for GPU based irregular reductions and its application to k-means clustering. In: Proceedings of the Fourth Workshop on General Purpose Processing on Graphics Processing Units, pp. 729–737. GPGPU-4, ACM, Newport Beach, March 2011Google Scholar
  23. 23.
    Gunarathne, T., Salpitikorala, B., Chauhan, A., Fox, G.: Optimizing OpenCL kernels for iterative statistical algorithms on GPUs. In: Proceedings of the Second International Workshop on GPUs and Scientific Applications, GPUScA 2011, pp. 33–44. Galveston Island, October 2011Google Scholar
  24. 24.
    Asensio-Cubero, J., Gan, J., Palaniappan, R.: Multiresolution analysis over simple graphs for brain computer interfaces. J. Neural Eng. 10(4) (2013)Google Scholar
  25. 25.
    Deb, K., Agrawal, S., Pratap, A., Meyarivan, T.: A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: NSGA-II. In: Schoenauer, M., Deb, K., Rudolph, G., Yao, X., Lutton, E., Merelo, J.J., Schwefel, H.-P. (eds.) PPSN 2000. LNCS, vol. 1917, pp. 849–858. Springer, Heidelberg (2000). doi: 10.1007/3-540-45356-3_83CrossRefGoogle Scholar
  26. 26.
    Fonseca, C., López-Ibáñez, M., Paquete, L., Guerreiro, A.: Computation of the hypervolume indicator. Accessed: 30 November 2015

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Juan José Escobar
    • 1
  • Julio Ortega
    • 1
  • Jesús González
    • 1
  • Miguel Damas
    • 1
  • Beatriz Prieto
    • 1
  1. 1.Department of Computer Architecture and Technology, CITICUniversity of GranadaGranadaSpain

Personalised recommendations