Skip to main content
SpringerLink
Log in

Components for bidirectional augmented broadcasting services on smart TVs

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

We present the core components to support bidirectional augmented broadcasting services on smart TVs. These components are considered to be very significant for next-generation media services. The key modules used in our proposed system provide users with special functions, allowing them to insert graphic models into common broadcasting contents themselves. Efficiently encoding the tracking information of both the position and orientation of the cameras and the light sources used during an entire video production is the most critical task at the transmitting side. The information is stored in a predefined rendering profile format and is used to render inserted objects photo-realistically and combine them with the original broadcasting contents at the receiving side. We employ cutting-edge techniques developed in the field of computer graphics to display the composed contents seamlessly on smart TVs. This new broadcasting service paradigm will satisfy the needs of high-end users who expect to play the role of content producers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

Notes

  1. An animation movie is also available at the following URL: http://graphics.dongguk.ac.kr/Student/ghhwang/MTA_without_author.mp4.

References

  1. Aittala M (2010) Inverse lighting and photorealistic rendering for augmented reality. Vis Comput 26:669–678

    Article  Google Scholar 

  2. Apodaca A, Gritz L (1999) Describing models and scenes in RenderMan. In: Advanced RenderMan. Morgan Kaufmann, San Mateo, pp 57–92

    Google Scholar 

  3. BBC (2012) The PIERO project. http://www.bbc.co.uk/rd/projects/virtual/piero. Accessed Jul 2012

  4. Beraldin J-A, Blais F, Cournoyer L, Godin G, Rioux M (2000) Active 3D sensing. Modelli E Metodi per lo studio e la conservazione dell’architettura storica, pp 22–46

  5. Carmigniani J, Furht B, Anisetti M, Ceravolo P, Damiani E, Ivkovic M (2011) Augmented reality technologies, system and applications. Multimedia Tools Appl 51(1):341–377

    Article  Google Scholar 

  6. Cavallaro R, Hybinette M, White M, Balch T (2011) Augmenting live broadcast sports with 3D tracking information. IEEE Multimedia 18(4):38–47

    Article  Google Scholar 

  7. Cheong W, Cha J, Ki M, Moon K (2008) Bidirectional interactive contents player for terrestrial digital multimedia broadcasting. IEEE Trans Consum Electron 54(1):93–99

    Article  Google Scholar 

  8. Cho K, Lee H, Ryu W (2011) Service trends and prospect on smart TV. Electron Telecommun Trends 26(4):1–13

    Google Scholar 

  9. Debevec P (1998) Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proc. of SIGGRAPH ’98, pp 189–198

  10. Denia A, Ribelles J, Lopez A, Belmonte O (2011) Low cost virtual animation effects for sports broadcasting mosaics, flags and big-sized flags. In: Proc. of 11th international conference on computational science and its applications, pp 10–16

  11. ETRI (2012) Smart System Research Team. http://www.etri.re.kr/etri/res/res_03020102.etri. Accessed Jul 2012

  12. Hartley R, Zisserman A (2000) N-view geometry, MultipleView geometry in computer vision. Cambridge University Press, Cambridge, pp 409–560

    Google Scholar 

  13. Hengel A, Dick A, Thormlen T, Ward B, Torr P (2007) Videotrace: rapid interactive scene modeling from video. In: Proc. of ACM SIGGRAPH 2007, article 86

  14. Hwang G, Park S(2012) Feature-based light and shadow estimation for video compositing and editing. Korea Computer Graphics Society 18(1):1–9

    Google Scholar 

  15. Jeong J-W, Hong H-K, Lee D-H (2011) Ontology-based automatic video annotation technique in smart TV environment. IEEE Trans Consum Electron 57(4):1830–1836

    Article  Google Scholar 

  16. Kanbara M, Yokoya N (2004) Real-time estimation of light source environment for photorealistic augmented reality. In: Proc. of international conference on pattern recognition 2004, pp 911–914

  17. Karsch K, Hedau V, Forsyth D, Hoiem D (2011) Rendering synthetic objects into legacy photographs. ACM Trans Graph 30(6):157:1–157:12

    Article  Google Scholar 

  18. Kim M, Park J (2011) Demand forecasting and strategies for the successfully deployment of the smart TV in Korea. In: Proc. of advanced communication technology conference, pp 1475–1478

  19. Kim M, Park J, Cho Y (2010) The industrial strategies for global leading of smart TV. Electron Telecommun Trends 25(5):147–158

    Google Scholar 

  20. Kim K, Ahn C, Hong J (2011) Research and standardization trends on smart TV. Electron Telecommun Trends 26(3):37–49

    Google Scholar 

  21. Kim S, Choi B, Jeong Y, Hong J, Chung J (2012) An architecture of augmented broadcasting service for next generation smart TV. In: Proceedings of international symposium on broadband multimedia systems and broadcasting, pp 1–4

  22. Kim S, Yoo J, Park H, Ko H (2012) Immersive panorama TV service system. In: 2012 IEEE international conference on consumer electronics (ICCE), pp 201–202

  23. Lee S, Jung S (2012) Estimation of illuminants for plausible lighting in augmented reality. In: Proc. of the international symposium on ubiquitous virtual reality 2011, pp 17–20

  24. Lee I, Lee H, Hong J, Cha J (2009) Interactive contents player for rich media service. IEEE Trans Consum Electron 55(1):112–118

    Article  Google Scholar 

  25. Madsen C, Nielsen M (2008) Towards probe-less augmented reality—a position paper. In: Proc. of GRAPP 2008, pp 255–261

  26. Morvan Y, Farin D, Pete HN (2008) System architecture for free-viewpoint video and 3D-TV. IEEE Trans Consum Electron 54:925–932

    Article  Google Scholar 

  27. Oh J (2010) Virtual reality in KBS TV. In: Proceedings of the 9th ACM SIGGRAPH conference on VRCAI 2010, pp 373–376

  28. Park S, Lim H, Kim H, Wu Y, Oh W (2012) Augmented data transmission for the ATSC terrestrial DTV system. IEEE Trans Broadcast 58(2):261–268

    Article  Google Scholar 

  29. Pollefeys M, Vergauwen M, Cornelis K, Tops J, Verbiest F, Gool L (2001) Structure and motion from image sequences. In: Proc. of conference on optical 3D measurement techniques, pp 251–258

  30. Ritschel T, Dachsbacher C, Grosch T, Kautz J (2012) The state of the art in interactive global illumination. Comput Graph Forum 31(1):160–188

    Article  Google Scholar 

  31. RT Software. TOG sports. http://rtsw.co.uk. Accessed Jul 2012

  32. Saito H (2011) Computer vision for 3D TV and augmented reality. In: Proc. of international symposium on ubiquitous virtual reality, pp 5–8

  33. SBS & SBS Contents Hub. http://conting.sbs.co.kr. Accessed Jul 2012

  34. Shesh A, Criminisi A, Rother C, Smyth G (2009) 3D-aware image editing for out of bounds photography. In: Proc. of graphics interface 2009, pp 46–54

  35. VIZRT. Viz Arena. http://www.vizrt.com/products/viz_virtual_studio. Accessed Jul 2012

  36. Voodoo Camera Tracker. http://www.digilab.uni-hannover.de. Accessed Jul 2012

  37. Yoon H, Woo W (2008) Design and implementation of a universal appliance controller based on selective interaction modes. IEEE Trans Consum Electron 54(4):1722–1729

    Article  Google Scholar 

  38. Zhang Y, Yang Y-H (2001) Multiple illuminant direction with application to image synthesis. IEEE Trans Pattern Anal Mach Intell 23:915–920

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the ETRI R&D program of KCC (Korea Communications Commission), Korea [11921-03001, “Development of Beyond Smart TV Technology”]. And the authors would like to thank Seoul Broadcasting System (SBS) & SBS Contents Hub for the rights to the broadcasting video clips used in these experiments.

Author information

Authors and Affiliations

  1. Department of Multimedia, Dongguk University, Seoul, 100-715, Republic of Korea

    Gyuhyun Hwang & Sanghun Park

  2. Smart System Research Team, ETRI, Daejeon, 305-700, Republic of Korea

    Seungchul Kim

Authors
  1. Gyuhyun Hwang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sanghun Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Seungchul Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sanghun Park.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hwang, G., Park, S. & Kim, S. Components for bidirectional augmented broadcasting services on smart TVs. Multimed Tools Appl 67, 687–708 (2013). https://doi.org/10.1007/s11042-012-1307-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-012-1307-6

Keywords

Search

Navigation