Restricted Boltzmann Machines for Gender Classification

  • Jordi Mansanet
  • Alberto AlbiolEmail author
  • Roberto Paredes
  • Mauricio Villegas
  • Antonio Albiol
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8814)


This paper deals with automatic feature learning using a generative model called Restricted Boltzmann Machine (RBM) for the problem of gender recognition in face images. The RBM is presented together with some practical learning tricks to improve the learning capabilities and speedup the training process. The performance of the features obtained is compared against several linear methods using the same dataset and the same evaluation protocol. The results show a classification accuracy improvement compared with classical linear projection methods. Moreover, in order to increase even more the classification accuracy, we have run some experiments where an SVM is fed with the non-linear mapping obtained by the RBM in a tandem configuration.


Representation learning RBM Gender classification 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bengio, Y., Courville, A., Vincent, P.: Representation learning: A review and new perspectives. IEEE Trans. on PAMI 35(8), 1798–1828 (2013)CrossRefGoogle Scholar
  2. 2.
    Bressan, M., Vitrià, J.: Nonparametric discriminant analysis and nearest neighbor classification. Pattern Recognition Letters 24(15), 2743–2749 (2003)CrossRefGoogle Scholar
  3. 3.
    Buchala, S., et al.: Dimensionality reduction of face images for gender classification. In: Proceedings of the Intelligent Systems, vol. 1, pp. 88–93 (2004)Google Scholar
  4. 4.
    Cai, D., He, X., Hu, Y., Han, J., Huang, T.: Learning a spatially smooth subspace for face recognition. In: CVPR, pp. 1–7 (2007)Google Scholar
  5. 5.
    Courville, A., Bergstra, J., Bengio, Y.: Unsupervised models of images by spike-and-slab rbms. In: ICML, pp. 1145–1152 (2011)Google Scholar
  6. 6.
    Huang, G.B., et al.: Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical Report 07–49, Univ. of Massachusetts (October 2007)Google Scholar
  7. 7.
    Schmah, T., et al.: Generative versus discriminative training of rbms for classification of fmri images. In: NIPS, pp. 1409–1416 (2008)Google Scholar
  8. 8.
    Graf, A.B.A., Wichmann, F.A.: Gender classification of human faces. In: Bülthoff, H.H., Lee, S.-W., Poggio, T.A., Wallraven, C. (eds.) BMCV 2002. LNCS, vol. 2525, pp. 491–500. Springer, Heidelberg (2002) CrossRefGoogle Scholar
  9. 9.
    He, X., Niyogi, P.: Locality preserving projections. In: NIPS (2004)Google Scholar
  10. 10.
    Hinton, G.E.: Training products of experts by minimizing contrastive divergence. Neural Comput. 14(8), 1771–1800 (2002)MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Hinton, G.E.: A practical guide to training restricted boltzmann machines. Technical report, University of Toronto (2010)Google Scholar
  12. 12.
    Hinton, G.E., Salakhutdinov, R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Moghaddam, B., Yang, M.-H.: Learning gender with support faces. IEEE Trans. on PAMI 24(5), 707–711 (2002)CrossRefGoogle Scholar
  14. 14.
    Nair, V., Hinton, G.E.: 3d object recognition with deep belief nets. In: NIPS, pp. 1339–1347 (2009)Google Scholar
  15. 15.
    Salakhutdinov, R., Mnih, A., Hinton, G.: Restricted boltzmann machines for collaborative filtering. In: ICML, pp. 791–798 (2007)Google Scholar
  16. 16.
    Shan, C.: Learning local binary patterns for gender classification on real-world face images. Pattern Recognition Letters 33(4), 431–437 (2012)CrossRefGoogle Scholar
  17. 17.
    Shobeirinejad, A., Gao, Y.: Gender classification using interlaced derivative patterns. In: ICPR, pp. 1509–1512 (2010)Google Scholar
  18. 18.
    Villegas, M., Paredes, R.: Dimensionality reduction by minimizing nearest-neighbor classification error. Pattern Recognition Letters 32(4), 633–639 (2011)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Jordi Mansanet
    • 1
  • Alberto Albiol
    • 1
    Email author
  • Roberto Paredes
    • 2
  • Mauricio Villegas
    • 2
  • Antonio Albiol
    • 1
  1. 1.iTEAM - Instituto de Telecomunicaciones y Aplicaciones MultimediaUniversitat Politècnica de ValènciaValenciaSpain
  2. 2.PRHLT Research CentreUniversitat Politècnica de ValènciaValenciaSpain

Personalised recommendations