Skip to main content

Singularity GPU Containers Execution on HPC Cluster

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11887))

Abstract

This paper describes how to use the Singularity containerization tool in a HPC cluster equipped with GPU accelerators. The application chosen for benchmarking is Tensorflow, the open-source software library for machine learning. The singularity containers built have run into GALILEO HPC cluster at CINECA. A performance comparison between bare metal and container executions is also provided, showing a negligible difference in the number of images computed per second.

Supported by Prace - Partnership for Advanced Computing in Europe - 5IP, http://www.prace-ri.eu/.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Docker. https://www.docker.com/

  2. Kurtzer, G.M., Sochat, V., Bauer, M.W.: Singularity: scientific containers for mobility of compute. PLoS ONE 12(5), e0177459 (2017). https://doi.org/10.1371/journal.pone.0177459

    Article  Google Scholar 

  3. Singularity. https://www.sylabs.io/

  4. Torque. http://www.adaptivecomputing.com/products/torque/

  5. PBS Pro. https://www.pbspro.org/

  6. Slurm. https://slurm.schedmd.com/

  7. Tensorflow. https://www.tensorflow.org/

  8. GALILEO cluster user documentation. https://wiki.u-gov.it/confluence/display/SCAIUS/UG3.3%3A+GALILEO+UserGuide

  9. Docker Hub. https://hub.docker.com/

  10. Singularity Hub. http://singularity-hub.org/

  11. Tensorflow Performance benchmarks. https://www.tensorflow.org/guide/performance/benchmarks

  12. Tensorflow Docker Hub. https://hub.docker.com/r/tensorflow/tensorflow/

  13. Krizhevsky, A., Sutskever, I., Hinton, G. E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)

    Google Scholar 

  14. Szegedy, C., et al.: Going deeper with convolutions. In: Computer Vision and Pattern Recognition (CVPR) (2015)

    Google Scholar 

  15. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision (2015). https://arxiv.org/abs/1512.00567

  16. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition (2015). https://arxiv.org/abs/1512.03385

  17. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition (2014). https://arxiv.org/abs/1409.1556

  18. ImageNet dataset. http://www.image-net.org/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Giuseppa Muscianisi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Muscianisi, G., Fiameni, G., Azab, A. (2019). Singularity GPU Containers Execution on HPC Cluster. In: Weiland, M., Juckeland, G., Alam, S., Jagode, H. (eds) High Performance Computing. ISC High Performance 2019. Lecture Notes in Computer Science(), vol 11887. Springer, Cham. https://doi.org/10.1007/978-3-030-34356-9_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-34356-9_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-34355-2

  • Online ISBN: 978-3-030-34356-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics