Advertisement

Distributed Training of 3DPyranet over Intel AI DevCloud Platform

  • Emanuel Di NardoEmail author
  • Fabio NarducciEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11874)

Abstract

Neural network architectures have demonstrated to achieve impressive results across a wide range of different domains. The availability of very large datasets makes possible to overcome the limitation of the training stage thus achieving significant level of performance. On the other hand, even though the advancements in GPU hardware, training a complex neural network model still represents a challenge. Long time is required when the computation is demanded to a single machine. In this work, a distributed training approach for 3DPyraNet model built for a specific domain, that is the emotion recognition from videos, is discussed. The proposed work aims at distributing the training procedures over the nodes of the Intel DevCloud Platform and demonstrating how the training performance are affected in terms of both computational demand and achieved accuracy compared to the use of a single machine. The results obtained in an experimental design suggests the feasibility of the approach for challenging computer vision tasks even in presence of limited computing power based on exclusive use of CPUs.

Keywords

Deep learning Distributed computing Distributed training Parallel computation 3DPyranet 

References

  1. 1.
    Cantoni, V., Petrosino, A.: Neural recognition in a pyramidal structure. IEEE Trans. Neural Netw. 13(2), 472–480 (2002)CrossRefGoogle Scholar
  2. 2.
    Chahal, K., Grover, M.S., Dey, K.: A hitchhiker’s guide on distributed training of deep neural networks. arXiv preprint arXiv:1810.11787 (2018)
  3. 3.
    Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)Google Scholar
  4. 4.
    Di Nardo, E., Petrosino, A., Ullah, I.: EmoP3D: a brain like pyramidal deep neural network for emotion recognition. In: Proceedings of the European Conference on Computer Vision (ECCV) (2018)Google Scholar
  5. 5.
    Goyal, P., et al.: Accurate, large minibatch SGD: training imagenet in 1 h. arXiv preprint arXiv:1706.02677 (2017)
  6. 6.
    Morency, L.-P., Mihalcea, R., Doshi, P.: Towards multimodal sentiment analysis: harvesting opinions from the web. In: Proceedings of the 13th International Conference On Multimodal Interfaces, pp. 169–176. ACM (2011)Google Scholar
  7. 7.
    Phung, S.L., Bouzerdoum, A.: A pyramidal neural network for visual pattern recognition. IEEE Trans. Neural Netw. 18(2), 329–343 (2007)CrossRefGoogle Scholar
  8. 8.
    Smith, S.L., Kindermans, P.-J., Ying, C., Le, Q.V.: Don’t decay the learning rate, increase the batch size. arXiv preprint arXiv:1711.00489 (2017)
  9. 9.
    Ullah, I., Petrosino, A.: A strict pyramidal deep neural network for action recognition. In: Murino, V., Puppo, E. (eds.) ICIAP 2015. LNCS, vol. 9279, pp. 236–245. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-23231-7_22CrossRefGoogle Scholar
  10. 10.
    Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Sig. Process. Lett. 23(10), 1499–1503 (2016)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.University of Naples ParthenopeNaplesItaly
  2. 2.University of MilanMilanItaly

Personalised recommendations