Enabling Interactive Supercomputing at JSC Lessons Learned
Research and analysis of large amounts of data from scientific simulations, in-situ visualization, and application control are convincing scenarios for interactive supercomputing. The open-source software Jupyter (or JupyterLab) is a tool that has already been used successfully in many scientific disciplines. With its open and flexible web-based design, Jupyter is ideal for combining a wide variety of workflows and programming methods in a single interface. The multi-user capability of Jupyter via JuypterHub excels it for scientific applications at supercomputing centers. It combines the workspace that is local to the user and the corresponding workspace on the HPC systems. In order to meet the requirements for more interactivity in supercomputing and to open up new possibilities in HPC, a simple and direct web access for starting and connecting to login or compute nodes with Jupyter or JupyterLab at Jülich Supercomputing Centre (JSC) is presented. To corroborate the flexibility of the new method, the motivation, applications, details and challenges of enabling interactive supercomputing, as well as goals and prospective future work will be discussed.
KeywordsInteractive supercomputing High Performance Computing Jupyter
This work is supported by the Rhinodiagnost project funded by the Zentrale Innovationsprogramm Mittelstand (ZIM) of the Federal Ministry of Economical Affairs and Energy (BMWi) and the InHPC-DE project as part of the SiVeGCS project to promote closer technical integration of the three GCS HPC centers in Stuttgart (HLRS), Jülich (JSC) and Munich (LRZ).
- 1.Benedyczak, K., Schuller, B., Petrova-ElSayed, M., Rybicki, J., Grunzke, R.: UNICORE 7 - middleware services for distributed and federated computing. In: 2016 International Conference on High Performance Computing and Simulation, Innsbruck, Austria, 18 July 2016–22 July 2016, pp. 613–620. IEEE (2016). https://doi.org/10.1109/HPCSim.2016.7568392. http://juser.fz-juelich.de/record/820611
- 6.Petrova-ElSayed, M., Benedyczak, K., Rutkowski, A., Schuller, B.: Federated computing on the web: the UNICORE portal. In: Proceedings of the 2016 39th International Convention on Information and Communication Technology, Electronics and Microelectronics, Opatija, Croatia, 30 May 2016–3 June 2016, pp. 190–195. IEEE (2016). ISBN 978-953-233-086-1. https://doi.org/10.1109/MIPRO.2016.7522133. http://juser.fz-juelich.de/record/820398