We consider the task of capturing the result of a researcher-driven stereo visualization of a complex dynamic virtual scene into a video sequence of stereo pairs (stereo clip) of ultrahigh resolution. An efficient technology of deferred synthesis of stereo clips is proposed. It allows one to create stereo clips without interfering with real-time visualization. The technology includes real-time construction of visualization scenario and offline transformation of the scenario into a stereo clip. Methods for implementing these stages for the task of stereo visualization of the saturation isosurface of displacing fluid are considered. For this purpose, a special file format «scr» for the visualization scenario is developed on the basis of chunk data structures. This format provides a compact representation of neighboring repeated frames. The scenario file is transformed into a sequence of 4K stereo pairs by means of the offscreen rendering technology of the virtual scene, and stereo pairs are added to the stereo clip using a number of open-source FFmpeg libraries designed for processing digital video content. The generated stereo clip is placed within an MP4 container, and the video compressing standard H.264 is used. The proposed technologies and methods of 4K stereo clip deferred synthesis are implemented in a software designed for visualizing simulation results of the unstable displacement of oil from porous media. Using this software, a 4K stereo clip is created, which illustrates the evolution of the saturation isosurface during the process of unstable oil displacement. Testing confirmed the validity of the solution. The software can be used in virtual laboratories, for designing virtual environment systems and scientific visualization systems, in educational applications etc.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Puzyrkov, D.V., Podryga, V.O., and Polyakov, S.V., Parallel processing and visualization for results of molecular simulation problems, Trudy ISP RAN, 2016, vol. 28, no. 2, pp. 221–242.
Gonakhchyan, V.I., Occlusion culling algorithm based on software visibility checks, Trudy ISP RAN, 2018, vol. 30, no. 2, pp. 81–98. https://doi.org/10.15514/ISPRAS-2018-30(2)-5
Nikitin, V.F., Stamov, L.I., Skryleva, E.I., Tyurenkova, V.V., and Mikhailyuk, M.V., Computer visualization of fluid displacement instability in porous medium, Proc. of the 68th International Astronautical Congress (IAC 2017), 2017, pp. 1–5.
Mikhaylyuk, M. and Timokhin, P., Effective GPU-based section visualization in isosurface of saturation of displacing liquid in a porous medium, Proc. of the 2018 International Conference on Engineering Technologies and Computer Science (EnT 2018), 2018, pp. 57–60.
Kozlov, I.V. and Skryleva, E.I., Mathematical modeling and data processing of water-oil displacement in neocomian sandstone, Vestn. Kibern., 2016, no. 2, pp. 138–145.
Mikhaylyuk, M.V., Maltsev, A.V., and Timokhin, P.Yu., Methods for 3D stereo visualization of data obtained in simulation of unstable oil displacement from porous media, Trudy NIISI RAN, 2018, vol. 8, no. 2, pp. 125–129.
Stereoscopic Player. http://www.3dtv.at/. Cited June 25, 2019.
Open Broadcaster Software. https://obsproject.com/. Cited June 25, 2019.
NVIDIA VIDEO CODEC SDK. https://developer.nvidia.com/nvidia-video-codec-sdk. Cited June 25, 2019.
Kushnirenko, A.G., Maltsev, A.V., Mikhaylyuk, M.V., Prilipko, A.A., Timokhin, P.Yu., and Torgashev, M.A., The compression of separated video streams for distance learning tasks, Izv. Akad. Inzhenern. Nauk, 2015, no. 2, pp. 3–10.
Guk, I., Features of video data compression under H. 264/MPEG 4 part 10 recommendation, Komponenty i Tekhnol., 2006, no. 2, pp. 1–10.
FFmpeg. A complete, cross-platform solution to record, convert and stream audio and video. https://ffmpeg.org/. Cited June 25, 2019.
Software for visualization of simulation results of unstable oil displacement, RF 2019614787, 2019. https://www1.fips.ru/registers-web/action?acName=clickRegister®Name=EVM. Cited June 25, 2019.
The publication is made within the state task on carrying out basic scientific researches (GP 14) on topic (project) “34.9. Virtual environment systems: technologies, methods and algorithms of mathematical modeling and visualization” (0580-2021-0012).
Translated by A. Klimontovich
About this article
Cite this article
Timokhin, P.Y., Mikhaylyuk, M.V., Vozhegov, E.M. et al. Technology and Methods for Deferred Synthesis of 4K Stereo Clips for Complex Dynamic Virtual Scenes. Program Comput Soft 47, 67–75 (2021). https://doi.org/10.1134/S0361768820070063