Skip to main content
SpringerLink
Log in

Technology and Methods for Deferred Synthesis of 4K Stereo Clips for Complex Dynamic Virtual Scenes

  • Published:
Programming and Computer Software Aims and scope Submit manuscript

Abstract

We consider the task of capturing the result of a researcher-driven stereo visualization of a complex dynamic virtual scene into a video sequence of stereo pairs (stereo clip) of ultrahigh resolution. An efficient technology of deferred synthesis of stereo clips is proposed. It allows one to create stereo clips without interfering with real-time visualization. The technology includes real-time construction of visualization scenario and offline transformation of the scenario into a stereo clip. Methods for implementing these stages for the task of stereo visualization of the saturation isosurface of displacing fluid are considered. For this purpose, a special file format «scr» for the visualization scenario is developed on the basis of chunk data structures. This format provides a compact representation of neighboring repeated frames. The scenario file is transformed into a sequence of 4K stereo pairs by means of the offscreen rendering technology of the virtual scene, and stereo pairs are added to the stereo clip using a number of open-source FFmpeg libraries designed for processing digital video content. The generated stereo clip is placed within an MP4 container, and the video compressing standard H.264 is used. The proposed technologies and methods of 4K stereo clip deferred synthesis are implemented in a software designed for visualizing simulation results of the unstable displacement of oil from porous media. Using this software, a 4K stereo clip is created, which illustrates the evolution of the saturation isosurface during the process of unstable oil displacement. Testing confirmed the validity of the solution. The software can be used in virtual laboratories, for designing virtual environment systems and scientific visualization systems, in educational applications etc.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig.1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.

Similar content being viewed by others

REFERENCES

  1. Puzyrkov, D.V., Podryga, V.O., and Polyakov, S.V., Parallel processing and visualization for results of molecular simulation problems, Trudy ISP RAN, 2016, vol. 28, no. 2, pp. 221–242.

    Google Scholar 

  2. Gonakhchyan, V.I., Occlusion culling algorithm based on software visibility checks, Trudy ISP RAN, 2018, vol. 30, no. 2, pp. 81–98. https://doi.org/10.15514/ISPRAS-2018-30(2)-5

    Article  Google Scholar 

  3. Nikitin, V.F., Stamov, L.I., Skryleva, E.I., Tyurenkova, V.V., and Mikhailyuk, M.V., Computer visualization of fluid displacement instability in porous medium, Proc. of the 68th International Astronautical Congress (IAC 2017), 2017, pp. 1–5.

  4. Mikhaylyuk, M. and Timokhin, P., Effective GPU-based section visualization in isosurface of saturation of displacing liquid in a porous medium, Proc. of the 2018 International Conference on Engineering Technologies and Computer Science (EnT 2018), 2018, pp. 57–60.

  5. Kozlov, I.V. and Skryleva, E.I., Mathematical modeling and data processing of water-oil displacement in neocomian sandstone, Vestn. Kibern., 2016, no. 2, pp. 138–145.

  6. Mikhaylyuk, M.V., Maltsev, A.V., and Timokhin, P.Yu., Methods for 3D stereo visualization of data obtained in simulation of unstable oil displacement from porous media, Trudy NIISI RAN, 2018, vol. 8, no. 2, pp. 125–129.

    Google Scholar 

  7. Stereoscopic Player. http://www.3dtv.at/. Cited June 25, 2019.

  8. Open Broadcaster Software. https://obsproject.com/. Cited June 25, 2019.

  9. NVIDIA VIDEO CODEC SDK. https://developer.nvidia.com/nvidia-video-codec-sdk. Cited June 25, 2019.

  10. Kushnirenko, A.G., Maltsev, A.V., Mikhaylyuk, M.V., Prilipko, A.A., Timokhin, P.Yu., and Torgashev, M.A., The compression of separated video streams for distance learning tasks, Izv. Akad. Inzhenern. Nauk, 2015, no. 2, pp. 3–10.

  11. Guk, I., Features of video data compression under H. 264/MPEG 4 part 10 recommendation, Komponenty i Tekhnol., 2006, no. 2, pp. 1–10.

  12. FFmpeg. A complete, cross-platform solution to record, convert and stream audio and video. https://ffmpeg.org/. Cited June 25, 2019.

  13. Software for visualization of simulation results of unstable oil displacement, RF 2019614787, 2019. https://www1.fips.ru/registers-web/action?acName=clickRegister&regName=EVM. Cited June 25, 2019.

Download references

Funding

The publication is made within the state task on carrying out basic scientific researches (GP 14) on topic (project) “34.9. Virtual environment systems: technologies, methods and algorithms of mathematical modeling and visualization” (0580-2021-0012).

Author information

Authors and Affiliations

  1. Federal State Institution “Scientific Research Institute for System Analysis of the Russian Academy of Sciences”, Nakhimovskii pr. 36/1, 117218, Moscow, Russia

    P. Yu. Timokhin, M. V. Mikhaylyuk, E. M. Vozhegov & K. D. Panteley

Authors
  1. P. Yu. Timokhin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. V. Mikhaylyuk
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. E. M. Vozhegov
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. K. D. Panteley
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to P. Yu. Timokhin, M. V. Mikhaylyuk, E. M. Vozhegov or K. D. Panteley.

Additional information

Translated by A. Klimontovich

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Timokhin, P.Y., Mikhaylyuk, M.V., Vozhegov, E.M. et al. Technology and Methods for Deferred Synthesis of 4K Stereo Clips for Complex Dynamic Virtual Scenes. Program Comput Soft 47, 67–75 (2021). https://doi.org/10.1134/S0361768820070063

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0361768820070063

Search

Navigation