Mathematical Models and Computer Simulations

, Volume 10, Issue 2, pp 135–144 | Cite as

Portable Solution for Modeling Compressible Flows on All Existing Hybrid Supercomputers

  • S. A. Soukov
  • A. V. Gorobets
  • P. B. Bogdanov


A variant of a numerical algorithm for simulating viscous gasdynamic flows on unstructured hybrid grids and its software implementation for heterogeneous computations is described. The system of Navier–Stokes equations is approximated by the finite-volume method of an increased approximation order with the values of the variables being defined at the mass centers of the grid elements. The distributed software implementation of the numerical algorithm is adapted to running on hybrid computer systems of various architectures. Comparative implementations were created using the MPI, OpenMP, CUDA, and OpenCL software models permitting the use of multicore processors and various types of accelerators, including NVIDIA and AMD graphics processors, and Intel Xeon Phi multicore coprocessors. The data exchange between MPI processes and between processors and accelerators is carried out simultaneously with the execution of calculations (both in MPI + OpenMP mode and when using CUDA or OpenCL). The indicators of parallel efficiency and performance on systems with different types of computing devices are studied in detail. In the tests, up to 260 GPUs were successfully used.


computational gas dynamics heterogeneous computations turbulent flows MPI OpenMP CUDA OpenCL 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    E. Elsen, P. le Gresley, and E. Darve, “Large calculation of the flow over a hypersonic vehicle using a gPU,” J. Comput. Phys. 227, 10148–10161 (2008).CrossRefzbMATHGoogle Scholar
  2. 2.
    P. Micikevicius, “3D finite difference computation on GPUs using CUDA,” in Proceeding of 2nd Workshop on General Purpose Processing on Graphics Processing Units, 2009.Google Scholar
  3. 3.
    D. A. Jacobsen and I. Senocak, “Multi-level parallelism for incompressible flow computations on GPU clusters,” Parallel Comput. 39, 1–20 (2013).MathSciNetCrossRefGoogle Scholar
  4. 4.
    P. Zaspel and M. Griebel, “Solving incompressible two-phase flows on multi-GPU clusters,” Comput. Fluids 80, 356–364 (2013).MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    A. A. Davydov, B. N. Chetverushkin, and E. V. Shil’nikov, “Simulating flows of incompressible and weakly compressible fluids on multicore hybrid computer systems,” Comput. Math. Math. Phys. 50, 2157–2165 (2010).MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    E. V. Koromyslov, M. V. Usanin, L. Yu. Gomzikov, A. A. Siner, and T. P. Lyubimova, “Numerical simulation of aerodynamic and noise characteristics of subsonic turbulent jets using graphic processing units,” Vychisl. Mekh. Sploshn. Sred 9 (1), 84–96 (2016).Google Scholar
  7. 7.
    A. V. Gorobets, F. X. Trias, and A. Oliva, “A parallel MPI + OpenMP + OpenCL algorithm for hybrid supercomputations of incompressible flows,” Comput. Fluids 88, 764–772 (2013).MathSciNetCrossRefGoogle Scholar
  8. 8.
    R. Rossi, F. Mossaiby, and S. R. Idelsohn, “A portable OpenCL-based unstructured edge-based finite element Navier-Stokes solver on graphics hardware,” Comput. Fluids 81, 134–144 (2013).MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    P. B. Bogdanov, A. V. Gorobets, and S. A. Sukov, “Adaptation and optimization of basic operations for an unstructured mesh CFD algorithm for computation on massively parallel accelerators,” Comput. Math. Math. Phys. 53, 1183–1194 (2013).MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    P. B. Bogdanov, A. A. Efremov, A. V. Gorobets, and S. A. Sukov, “Using a scheduler for efficient data exchange on hybrid supercomputers with massively-parallel accelerators,” Vychisl. Metody Program. 14, 122–134 (2013).Google Scholar
  11. 11.
    A. V. Chikitkin, V. A. Titarev, M. N. Petrov, and S. V. Utyuzhnikov, “Parallel technologies for aerodynamics problems solving in FlowModellium software complex,” in Proceedings of the Conference on Supercomputer Days in Russia, Sept. 26–27, 2016, Moscow.Google Scholar
  12. 12.
    E. F. Toro, Riemann Solvers and Numerical Methods for Fluid Dynamics: A Practical Introduction, 3rd ed. (Springer, Berlin, Heidelberg, 2009).CrossRefzbMATHGoogle Scholar
  13. 13.
    E. N. Golovchenko and M. V. Yakobovskii, “Parallel partitioning tool GridSpiderPar for large mesh decomposition,” Vychisl. Metody Program. 16, 507–517 (2015).Google Scholar

Copyright information

© Pleiades Publishing, Ltd. 2018

Authors and Affiliations

  • S. A. Soukov
    • 1
  • A. V. Gorobets
    • 1
  • P. B. Bogdanov
    • 2
  1. 1.Keldysh Institute of Applied MathematicsRussian Academy of SciencesMoscowRussia
  2. 2.Institute of System ResearchRussian Academy of SciencesMoscowRussia

Personalised recommendations