Skip to main content
SpringerLink
Log in

ppOpen-HPC/pK-Open-HPC: Application Development Framework with Automatic Tuning (AT)

  • Chapter
  • First Online:
Book cover Advanced Software Technologies for Post-Peta Scale Computing

  • 463 Accesses

Abstract

ppOpen-HPC and pK-Open-HPC are open source infrastructures for development and execution of large-scale scientific applications on post-petascale (pp) supercomputers with automatic tuning (AT). Both of ppOpen-HPC and pK-Open-HPC focus on parallel computers based on many-core architectures and consist of various types of libraries covering general procedures for scientific computations. The source code, developed on a PC with a single processor, is linked with these libraries, and the parallel code generated is optimized for post-petascale systems. In this article, recent achievements and progress of the ppOpen-HPC and pK-Open-HPC project are summarized.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. ppOpen-HPC.: http://ppopenhpc.cc.u-tokyo.ac.jp/. Accessed 23 Mar 2018

  2. Nakajima, K., Satoh, M., Furumura, T., Okuda, H., Iwashita, T., Sakaguchi, H., Katagiri, T., Matsumoto, M., Ohshima, M., Jitsumoto, H., Arakawa, T., Mori, F., Kitayama, T., Ida, A., Matsuo, M.Y.: ppOpen-HPC: open source infrastructure for development and execution of large-scale scientific applications on post-peta-scale supercomputers with automatic tuning (AT). In: Optimization in the Real World -Towards Solving Real-Worlds Optimization Problems, Mathematics for Industry, vol. 13, pp. 15–35. Springer, Beijing (2015)

    Google Scholar 

  3. Joint Center for Advanced High Performance Computing (JCAHPC): http://jcahpc.jp/. Accessed 23 Mar 2018

  4. Post-Peta CREST.: http://postpeta.jst.go.jp/en/. Accessed 23 Mar 2018

  5. ESSEX.: http://blogs.fau.de/essex/. Accessed 23 Mar 23 2018

  6. SPPEXA.: http://www.sppexa.de/. Accessed 23 Mar 23 2018

  7. Dezeeuw, D., Powell, K.G.: An adaptively refined Cartesian mesh solver for the Euler equations. J. Comput. Phys. 104, 56–68 (1993)

    Article  Google Scholar 

  8. Matsumoto, M., Mori, F., Ohshima, S., Jitsumoto, H., Katagiri, T., Nakajima, K.: Implementation and evaluation of an AMR framework for FDM applications. Proc. Comput. Sci. 29, 936–946 (2014)

    Article  Google Scholar 

  9. Usui, H., Nagara, A., Nunami, M., Matsumoto, M.: Development of a computational framework for block-based AMR simulations. Proc. Comput. Sci. 29, 2351–2359 (2014)

    Article  Google Scholar 

  10. Miyashita, M., Matsumoto, M., Kubota, K.: The development of adaptive mesh refinement technique for hybrid kinetic/fluid plasma simulation. In: Proceedings of 2015 International Conference on Numerical Simulation of Plasmas (ICNSP2015) (2015)

    Google Scholar 

  11. Usui, H., Kito, S., Nunami, M., Matsumoto, M.: Application of block-structured adaptive mesh refinement to particle simulation. Proc. Comput. Sci. 108, 2527–2536 (2017)

    Article  Google Scholar 

  12. Sakurai, T., Sugiura, H.: A projection method for generalized eigenvalue problems using numerical integration. J. Comput. Appl. Math. 159(1), 119–128 (2003)

    Article  MathSciNet  Google Scholar 

  13. Galgon, M., Lukas, K., Lang, B.: The FEAST algorithm for large eigenvalue problems. Proc. Parallel Appl. Math. Mech. (PAMM). 11(1), 747–748 (2011)

    Article  Google Scholar 

  14. Kawai, M., Ida, A., Nakajima, K.: Modified IC Preconditioner of CG method for ill-conditioned problems. IPSJ SIG, Technical Report 2017-HPC-158-9 (2017.) (in Japanese)

    Google Scholar 

  15. Kawai, M., Ida, A., Nakajima, K.: Hierarchical parallelization of multi-coloring algorithms for block IC, preconditioners. In: IEEE 19th International Conference on High Performance Computing and Communications (HPCC), pp. 138–145 (2017)

    Google Scholar 

  16. Saad, Y.: Iterative Methods for Sparse Linear Systems, 2nd edn. SIAM, Philadelphia (2003)

    Book  Google Scholar 

  17. Iwashita, T., Shimasaki, M.: Algebraic multicolor ordering for parallelized ICCG solver in finite-element analyses. IEEE Trans. Magn. 38(2), 429–432 (2002)

    Article  Google Scholar 

  18. Davis, T.A., Hu, Y.: The University of Florida sparse matrix collection. ACM Trans. Math. Softw. (TOMS). 38(1), 1–25 (2011)

    MathSciNet  MATH  Google Scholar 

  19. Katagiri, T., Ohshima, S., Matsumoto, M.: Directive-based auto-tuning for the finite difference method on the Xeon Phi. In: IEEE Proceedings of IPDPSW2015, pp. 1221–1230 (2015)

    Google Scholar 

  20. Katagiri, T., Ohshima, S., Matsumoto, M.: Auto-tuning on NUMA and many-core environments with an FDM code. In: IEEE Proceedings of IPDPSW2017, pp. 1399–1407 (2017)

    Google Scholar 

  21. Washington, W.M., Buja, L., Craig, A.: The computational future for climate and earth sys-tem models: on the path to petaflop and beyond. Phil. Trans. R. Soc. A. 367, 833–846 (2009)

    Article  Google Scholar 

  22. Satoh, M., Tomita, H., Yashiro, H., Miura, H., Kodama, C., Seiki, T., Noda, A., Yamada, Y., Goto, D., Sawada, M., Miyoshi, T., Niwa, Y., Hara, M., Ohno, T., Iga, S., Arakawa, T., Inoue, T., Kubokawa, H.: The non-hydrostatic icosahedral atmospheric model: description and development. Prog Earth Planet Sci. 1, (2014). https://doi.org/10.1186/s40645-014-0018-1

  23. Hasumi, H.: CCSR Ocean Component Model (COCO) Version 4.0. http://ccsr.aori.utokyo.ac.jp/hasumi/COCO/coco4.pdf. Accessed 23 Mar 2018

  24. Jones, P.H.: First and second order conservative remapping schemes for grids in spherical coordinates. Mon. Weather Rev. 127, 2204–2210 (1999)

    Article  Google Scholar 

  25. Miyakawa, T., Yashiro, H., Suzuki, T., Tatebe, H., Satoh, M.: A Madden-Julian oscillation-event remotely accelerates ocean upwelling to abruptly terminate the 1997/1998 super El Nino. Geophys. Res. Lett. 44, 9489 (2017). https://doi.org/10.1002/2017GL074683

    Article  Google Scholar 

  26. Iwashita, T., Ida, A., Mifune, T., Takahashi, Y.: Software framework for parallel BEM analyses with H-matrices using MPI and OpenMP. Proc. Comput. Sci. 108C, 2200–2209 (2017)

    Article  Google Scholar 

  27. Ida, A., Iwashita, T., Mifune, T., Takahashi, Y.: Parallel hierarchical matrices with adaptive cross approximation on symmetric multiprocessing clusters. J. Inf. Process. 22(4), 642–650 (2014)

    Google Scholar 

  28. Ida, A., Nakashima, H., Kawai, M.: Parallel hierarchical matrices with block low-rank representation on distributed memory computer systems. In: ACM Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region (HPC Asia 2018), pp. 232–240 (2018)

    Chapter  Google Scholar 

  29. Ida, A.: Lattice H-matrices on distributed-memory systems. In: Proceedings of IEEE International Parallel and Distributed Processing Symposium (IPDPS) (2018). in press

    Google Scholar 

Download references

Acknowledgments

This work is supported by Core Research for Evolutional Science and Technology (CREST), the Japan Science and Technology Agency (JST), Japan, and the German Priority Programme 1648 Software for Exascale Computing (SPPEXA-II). Authors would like to thank Professor Gerhard Wellein (Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany) and members of the ESSEX-II project.

Author information

Authors and Affiliations

  1. The University of Tokyo, Tokyo, Japan

    Kengo Nakajima, Masaharu Matsumoto, Masatoshi Kawai & Akihiro Ida

  2. Nagoya University, Nagoya, Aichi, Japan

    Takahiro Katagiri

  3. Research Organization for Information Science and Technology (RIST), Tokyo, Japan

    Takashi Arakawa

  4. RIKEN Advanced Institute for Computational Science (AICS), Kobe, Hyogo, Japan

    Hisashi Yashiro

Authors
  1. Kengo Nakajima
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masaharu Matsumoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Masatoshi Kawai
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Takahiro Katagiri
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Takashi Arakawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hisashi Yashiro
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Akihiro Ida
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kengo Nakajima .

Editor information

Editors and Affiliations

  1. RIKEN Center for Computational Science, Kobe, Japan

    Mitsuhisa Sato

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Nakajima, K. et al. (2019). ppOpen-HPC/pK-Open-HPC: Application Development Framework with Automatic Tuning (AT). In: Sato, M. (eds) Advanced Software Technologies for Post-Peta Scale Computing. Springer, Singapore. https://doi.org/10.1007/978-981-13-1924-2_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-1924-2_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-1923-5

  • Online ISBN: 978-981-13-1924-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation