Skip to main content
SpringerLink
Log in

Toward cinematizing our daily lives

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

We introduce a cinematographic video production system to create movie-like attractive footage from our indoor daily life. Since the system is designed for ordinary users in non-studio environments, it is composed of standard hardware components, provides a simple interface, and works in near real-time of 5 ~ 6 frames/sec. The proposed system reconstructs a visual hull from acquired multiple videos and then generates final videos from the model by referring to the camera shots used in film-making. The proposed method utilizes “Reliability” to compensate for errors that may have occurred in non-studio environments and to produce the most natural scene from the reconstructed model. By using a virtual camera control system, even non-experts can easily convert the 3D model to movies that look as if they were created by experienced filmmakers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  1. Ahn J, Byun H (2006) Accurate foreground extraction using graph cut with trimap estimation. Proc. PSIVT, pp. 1185–1194

  2. Allili MS, Bouguila N, Ziou D (2007) Finite generalized gaussian mixture modeling and applications to image and video foreground segmentation. Proc CRV, pp. 183–190

  3. Arijon D (1991) Grammar of the Film Language. Silman-James Press

  4. Bresenham J (1965) Algorithm for computer control of a digital plotter. IBM Syst J 4(1):25–30

    Article  Google Scholar 

  5. Elgammal A, Harwood D, Davis LS (2000) Non-parametric model for background subtraction. Proc. ECCV 2:751–767

    Google Scholar 

  6. Fabiz F, Cheok A, Wei L, Zhiying Z, Ke X, Prince S, Billinghurst M, Kato H (2005) Live three-dimensional content for augmented reality. IEEE Tans Multimedia 7(3):514–523

    Article  Google Scholar 

  7. Furht B (Ed.) (2008) Encyclopedia of Multimedia, 2nd ed. pp.170–171, Springer

  8. Gelasca ED, Ebrahimi T, Karaman M, Sikora T (2006) A Framework for evaluating video object segmentation algorithms. Proc CVPR Workshop, pp. 198

  9. Grauman K, Shakhnarovich G, Darrell T (2003) A bayesian approach to image-based visual hull reconstruction. Proc. CVPR, pp. 187–194

  10. Gross M, Würmlin S, Naef M, Lamboray E, Spagno C, Kunz A, Koller-Meier E, Svoboda T, Van Gool L, Lang S, Strehlke K, Vande Moere A, Staadt O (2003) Blue-C: a spatially immersive display and 3d video portal for telepresence. Proc. SIGGRAPH, pp. 819–827

  11. Guan L, Franco JS, Pollefeys M (2007) 3D Occlusion inference from silhouette cues. Proc CVPR, pp. 1–8

  12. Gueziec A, Hummel R (1995) Exploiting triangulated surface extraction using tetrahedral decomposition. IEEE TVCG 1(4):328–342

    Google Scholar 

  13. Guillemaut J-Y, Hilton A, Starck J, Kilner J, Grau O (2007) A bayesian framework for simultaneous matting and 3D reconstruction. Proc 3DIM, pp. 167–176

  14. Han B, Comaniciu D, Davis L (2004) Sequential kernel density approximation through mode propagation: applications to background modeling. Proc ACCV

  15. He L, Cohen MF, Salesin DH (1996) The virtual cinematographer: a paradigm for automatic real-time camera control and directing. Proc ICCGIT, pp. 217–224

  16. Inoue A, Shigeno H, Okada K, Matsushita Y (2004) Introducing grammar of the film language into automatic shooting for face-to-face meetings. Proc SAINT, pp. 277–280

  17. Kanade T, Rander PW, Narayanan PJ (1997) Virtualized reality: constructing virtual worlds from real scenes. IEEE Multimedia 4(1):34–47

    Article  Google Scholar 

  18. Katz SD (2004) Cinematic Motion: Film Directing: A Workshop for Staging Scenes. Michael Wiese Film Productions

  19. Kim H, Kitahara I, Sakamoto R, Kogure K (2006) An Immersive free-viewpoint video system using multiple outer/inner cameras. Proc 3DPVT

  20. Kim H, Sakamoto R, Kitahara I, Toriyama T, Kogure K (2007a) Reliability-based 3D reconstruction in real environment. Proc. ACM Multimedia pp. 257–260

  21. Kim H, Sakamoto R, Kitahara I, Toriyama T, Kogure K (2007b) Robust foreground extraction technique using Gaussian family model and multiple thresholds. Proc ACCV

  22. Kumar P, Sengupta K, Ranganath S (2000) Real time detection and recognition of human profiles using inexpensive desktop cameras. Proc ICPR, pp.1096–1099

  23. Lee JY, Nandi AK (1999) Maximum likelihood parameter estimation of the asymmetric generalized gaussian family of distribution. Proc SPW-HOS

  24. Lee DS, Hull JJ, Erol B (2003) A bayesian framework for gaussian mixture background modeling. Proc ICIP 3:973–976

    Google Scholar 

  25. Li M, Magnor M, Seidel HP (2003) Improved hardware-accelerated visual hull rendering. Proc Vision, Modeling, and Visualization

  26. Lorensen WE, Cline HE (1987) Marching cubes: a high resolution 3d surface constructing algorithm. Proc SIGGRAPH, pp.163–169.

  27. Magnor MA (2005) Video-Based Rendering. A K Peters

  28. Matsuyama T, Wu X, Takai T, Wada T (2004) Real-time dynamic 3-D object shape reconstruction and high-fidelity texture mapping for 3-D video. IEEE Trans CSVT 14(3):357–369

    Google Scholar 

  29. Mittal A, Paragios N (2004) Motion-based background subtraction using adaptive kernel density estimation. Proc CVPR, pp. 302–309

  30. Nobuhara S, Matsuyama T (2006) Deformable mesh model for complex multi-object 3D motion estimation from multi-viewpoint video. Proc 3DPVT, pp.264–271

  31. Piccardi M (2004) Background subtraction techniques: a review. Proc IEEE SMC 4:3099–3104

    Google Scholar 

  32. Porikli F, Tuzel O (2003) Human body tracking by adaptive background models and mean-shift analysis. Proc Pets-ICVS

  33. Ronfard R, Taubin G (2007) Introducing 3D cinematography. IEEE CG&A 27(3):18–20

    Google Scholar 

  34. Sormann M, Zach C, Karner K (2006) Graph cut based multiple view segmentation for 3D reconstruction. Proc 3DPVT, pp. 1085–1092

  35. Starck J, Hilton A (2007) Surface capture for performance-based animation. IEEE CG&A 27(3):21–31

    Google Scholar 

  36. Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking. Proc CVPR, 246–252

  37. Takai T, Nobuhara S, Yoshimoto H, Matsuyama T (2006) 3D video technologies: capturing high fidelity full 3D shape, motion, and texture. Proc ISMAR Workshop

  38. Tenmoku R, Ichikari R, Shibata F, Kimura A, Tamura H (2007) Design and prototype implementation of Mr pre-visualization workflow. Proc ISMAR Workshop for Mixed Reality Entertainment and Art

  39. Triggs B, McLauchlan P, Hartley R, Fitzgibbon A (1999) bundle adjustment—a modern synthesis. Proc International Workshop on Vision Algorithms: Theory and Practice, pp.298–372

  40. Tuzel O, Porikli F, Meer P (2005) A bayesian approach to background modeling. Proc IEEE MVIV 3:58–63

    Google Scholar 

  41. Ueda M, Arita D, Taniguchi R (2004) Real-time free-viewpoint video generation using multiple cameras and a PC-cluster. Proc PCM, LNCS 3331, pp. 418–425

  42. Wren C, Azarbayejani A, Darrell T, Pentland AP (1997) Pfinder: real-time tracking of the human body. IEEE Trans. PAMI 19(7):780–785

    Google Scholar 

  43. Yamazaki S, Sagawa R, Kawasaki H, Ikeuchi K, Sakauchi M (2002) Microfacet billboarding. Proc Eurographics Workshop on Rendering, pp. 175–186

Download references

Acknowledgements

This research was supported in part by the National Institute of Information and Communications Technology and KAKENHI(20700122).

Author information

Authors and Affiliations

  1. Centre for Vision, Speech and Signal Processing in University of Surrey, Guildford, Surrey, UK

    Hansung Kim

  2. Wakayama University, Wakayama, Japan

    Ryuuki Sakamoto

  3. Department of Intelligent Interaction Technologies, University of Tsukuba, Tsukuba, Japan

    Itaru Kitahara

  4. Toyama Prefectural University, Imizu, Japan

    Tomoji Toriyama

  5. Knowledge Science Laboratories, ATR, Kyoto, 619-0288, Japan

    Kiyoshi Kogure

Authors
  1. Hansung Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ryuuki Sakamoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Itaru Kitahara
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tomoji Toriyama
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kiyoshi Kogure
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hansung Kim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kim, H., Sakamoto, R., Kitahara, I. et al. Toward cinematizing our daily lives. Multimed Tools Appl 44, 87–110 (2009). https://doi.org/10.1007/s11042-009-0274-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-009-0274-z

Keywords

Search

Navigation