Skip to main content

Fast FFT-Based Inference in 3D Convolutional Neural Networks

  • Conference paper
  • First Online:
  • 1376 Accesses

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 773))

Abstract

Recognizing real world objects based on their 3D shapes is an important problem in robotics, computational medicine, and the internet of things (IoT) applications. In the recent years, deep learning has emerged as the foremost tool for a wide range of recognition and classification problems. However, the main problem of convolutional neural networks, which are the primary deep learning systems for such tasks, lies in the high computational cost required to train and use them, even for 2D problems. For 3D problems, the problem becomes even more pressing, and requires new methods to keep up with the further increase in computational cost. One such method is the use of Fast Fourier Transforms to reduce the computational cost by performing convolution operations in the Fourier domain. Recently, this method has seen widespread use for 2D problems. In this paper, we implement and test the method for 2D and 3D object recognition problems and compare it to the traditional convolution methods. We test our network on the ShapeNet 3D object library, achieving superior performance without any loss in accuracy compared to conventional methods.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)

    Google Scholar 

  2. Fan, J., Xu, W., Wu, Y., Gong, Y.: Human tracking using convolutional neural networks. IEEE Trans. Neural Netw. 21(10), 1610–1623 (2010)

    Article  Google Scholar 

  3. Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection, arXiv preprint arXiv:1506.02640

  4. Xiang, Y., Kim, W., Chen, W., Ji, J., Choy, C., Su, H., Mottaghi, R., Guibas, L., Savarese, S.: ObjectNet3d: a large scale database for 3D object recognition. In: European Conference on Computer Vision, pp. 160–176. Springer, (2016)

    Chapter  Google Scholar 

  5. Chang, A.X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al.: ShapeNet: an information-rich 3D model repository, arXiv preprint arXiv:1512.03012

  6. Maturana, D., Scherer, S.: VoxNet: a 3D convolutional neural network for real-time object recognition. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 922–928. IEEE (2015)

    Google Scholar 

  7. Mathieu, M., Henaff, M., LeCun, Y.: Fast training of convolutional networks through FFTs, arXiv preprint arXiv:1312.5851

  8. Han, S., Mao, H., Dally, W.J.: A deep neural network compression pipeline: pruning, quantization, huffman encoding, arXiv preprint arXiv:1510.00149

  9. Chen, W., Wilson, J.T., Tyree, S., Weinberger, K.Q., Chen, Y.: Compressing neural networks with the hashing trick, CoRR, abs/1504.04788

    Google Scholar 

  10. Wu, J., Leng, C., Wang, Y., Hu, Q., Cheng, J.: Quantized convolutional neural networks for mobile devices, arXiv preprint arXiv:1512.06473

  11. Lin, D.D., Talathi, S.S., Annapureddy, V.S.: Fixed point quantization of deep convolutional networks, arXiv preprint arXiv:1511.06393

  12. Gupta, S., Agrawal, A., Gopalakrishnan, K., Narayanan, P.: Deep learning with limited numerical precision, CoRR, abs/1502.02551 392

    Google Scholar 

  13. Rastegari, M., Ordonez, V., Redmon, J., Farhadi, A.: XNOR-Net: ImageNet classification using binary convolutional neural networks, arXiv preprint arXiv:1603.05279

  14. Cong, J., Xiao, B.: Minimizing computation in convolutional neural networks. In: International Conference on Artificial Neural Networks, pp. 281–290. Springer (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bo Xie .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Xie, B., Zhang, G., Shen, Y., Liu, S., Ge, Y. (2019). Fast FFT-Based Inference in 3D Convolutional Neural Networks. In: Barolli, L., Xhafa, F., Javaid, N., Enokido, T. (eds) Innovative Mobile and Internet Services in Ubiquitous Computing. IMIS 2018. Advances in Intelligent Systems and Computing, vol 773. Springer, Cham. https://doi.org/10.1007/978-3-319-93554-6_40

Download citation

Publish with us

Policies and ethics