Abstract
OpenFOAM (Open Field Operation and Manipulation) is a complete open-source framework for the solution of Partial Differential Equations (PDE) using the Finite Volume Method. It is one of the most popular open source tools used in Continuum Mechanics and Computational Fluid Dynamics (CFD). In this study, we used DirectNumerical Simulation and Large Eddy Simulation to investigate the scalability and MPI characteristics of OpenFOAM. Semi-implicit methods were applied to two representative benchmark problems. Three-dimensional laminar cavity flow, solved by direct numerical simulation, and turbulent backward facing step, solved by LES. The latter problem represents a configuration with common features found in many engineering applications. Strong and weak scaling behaviour using GNU and Intel compiler are compared and MPI routines are traced by CRAY’s profiling tools in detail.
References
Cray Research Inc.: Optimizing applications on the Cray X1 system. URL http://docs.cray.com/books/S-2315-52/html-S-2315-52/index.html (2002)
CSC IT Center: OpenFOAM -CSC (2010). https://research.csc.fi/-/openfoam
Duran, A., Celebi, M.S., Piskin, S., Tuncel, M.: Scalability of OpenFOAM for bio-medical flow simulations. J. Supercomput. 71 (3), 938–951 (2015). doi:10.1007/s11227-014-1344-1, http://dx.doi.org/10.1007/s11227-014-1344-1
Pope, S.B.: Turbulent flows (2000). doi:10.1088/0957-0233/12/11/705, https://books.google.com/books?hl=fr{&}lr={&}id=HZsTw9SMx-0C{&}pgis=1$\backslash$nhttp://www.mendeley.com/catalog/turbulent-flows-19/, arXiv:1011.1669v3
Pringle, G.J.: Porting OpenFOAM to HECToR. A dCSE project (2010). http://www.hector.ac.uk/cse/distributedcse/reports/openfoam/openfoam.pdf
Smagorinsky, J.: General circulation experiments with the primitive equations. Mon. Weather Rev. 91 (3), 99–164 (1963). doi:10.1175/1520-0493(1963)091¡0099:GCEWTP¿2.3.CO;2, http://journals.ametsoc.org/doi/abs/10.1175/1520-0493{%}281963{%}29091{%}3C0099{%}3AGCEWTP{%}3E2.3.CO{%}3B2
Tvergaard, V., Hutchinson, J.W.: Two mechanisms of ductile fracture: void by void growth versus multiple void interaction. PhD thesis (2002). doi:10.1016/S0020-7683(02)00168-3
Weller, H.G., Tabor, G., Jasak, H., Fureby, C.: A tensorial approach to computational continuum mechanics using object-oriented techniques. Comput. Phys. 12 (6), 620–631 (1998). doi:10.1063/1.168744
Acknowledgements
We greatly acknowledge the provision of supercomputing time and technical support by the High Performance Computing Center Stuttgart (HLRS).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Axtmann, G., Rist, U. (2016). Scalability of OpenFOAM with Large Eddy Simulations and DNS on High-Performance Systems. In: Nagel, W.E., Kröner, D.H., Resch, M.M. (eds) High Performance Computing in Science and Engineering ´16. Springer, Cham. https://doi.org/10.1007/978-3-319-47066-5_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-47066-5_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-47065-8
Online ISBN: 978-3-319-47066-5
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)