Heterogeneous Exascale Computing
Exascale services bring new unique challenges that the current computational, big data and workflow solutions are unable to meet. The chapter includes a detailed description of selected exascale services with known state of the art in extreme date solutions. The integration of requirements and the analysis of the state of the art in the exascale field is centered in on a description of a high-level architectural approach. The next main contribution of the paper is the description of the architecture capable to handle heterogeneous exascale services coming from both academic as well as industrial sphere. Those two models represent a (conceptual, and technological) design of a platform that addresses the requirements of the use cases. The resulting architecture will help us provide computing solutions to exascale challenges within the H2020 project PROCESS.
This work is supported by projects EU H2020-777533 PROCESS PROviding Computing solutions for ExaScale ChallengeS, APVV-17-0619, and VEGA 2/0167/16.
- 1.R. Agarwal, G. Juve, E. Deelman, Peer-to-peer data sharing for scientific workflows on amazon ec2, in 2012 SC Companion: High Performance Computing, Networking, Storage and Analysis (SCC) (IEEE, 2012), pp. 82–89Google Scholar
- 2.B. Allcock, I. Mandrichenko, T. Perelmutov, Gridftp v2 protocol description. GridFTP Working Group, Technical report, 2005Google Scholar
- 3.S. Ashby, P. Beckman, J. Chen, P. Colella, B. Collins, D. Crawford, J. Dongarra, D. Kothe, R. Lusk, P. Messina, et al., The opportunities and challenges of exascale computing–summary report of the advanced scientific computing advisory committee (ASCAC) subcommittee. US Department of Energy Office of Science (2010)Google Scholar
- 4.M. Bobák, A.S.Z. Belloum, P. Nowakowski, J. Meizner, M. Bubak, M. Heikkurinen, O. Habala, L. Hluchý, Exascale computing and data architectures for brownfield applications, in 2018 14th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) (IEEE, 2018), pp. 461–468Google Scholar
- 5.J. Chen, A. Choudhary, S. Feldman, B. Hendrickson, C. Johnson, R. Mount, V. Sarkar, V. White, D. Williams, Synergistic challenges in data-intensive science and exascale computing: doe ASCAC data subcommittee report (2013)Google Scholar
- 8.K. He, X. Zhang, S. Ren, J. Sun, Deep residual learning for image recognition, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016), pp. 770–778Google Scholar
- 9.O. Jimenez-del Toro, S. Otálora, M. Andersson, K. Eurén, M. Hedlund, M. Rousson, H. Müller, M. Atzori, Analysis of histopathology images: from traditional machine learning to deep learning, in Biomedical Texture Analysis (Elsevier, Amsterdam, 2018), pp. 281–314Google Scholar
- 12.Z. Liu, J. Li, Z. Shen, G. Huang, S. Yan, C. Zhang, Learning efficient convolutional networks through network slimming, in 2017 IEEE International Conference on Computer Vision (ICCV) (IEEE, 2017), pp. 2755–2763Google Scholar
- 13.G. Montavon, W. Samek, K.-R. Müller, Methods for interpreting and understanding deep neural networks. Digit. Signal Process. (2017)Google Scholar
- 14.R. Rudari, F. Silvestro, L. Campo, N. Rebora, G. Boni, CIMA Research Foundation, C. Herold, UNEP-GRID, Improvement of the global food model for the gar 2015. Global Assessment Report on Disaster Risk Reduction 2015 (2015)Google Scholar
- 16.A. Sim, A. Shoshani, The storage resource manager interface specification, version 2.2, in CERN, FNAL, JLAB, LBNL and RAL (Citeseerx, 2007)Google Scholar
- 18.Storage Networking Industry Association. Cloud data management interface (CDMI) (2010)Google Scholar
- 19.C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A. Rabinovich, Going deeper with convolutions, in Proceedings of the IEEE conference on computer vision and pattern recognition (2015), pp. 1–9Google Scholar