Skip to main content

Joint Multiview Video Plus Depth Coding with Saliency Approach

  • Conference paper
  • First Online:
Microelectronics, Electromagnetics and Telecommunications

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 471))

Abstract

The main consideration of compression efficiency in multiview is to venture the temporal and interview analytical dependencies since all cameras capture the particular frame with variable viewpoints. The era of multiview coding (MVC) predictor selection statistics is used to compress MVD representation resulting in separate bitstreams of texture and video sequences. These coding schemes do not capture the similarities that arise in texture and depth video sequence, whereas joint multiview video plus depth coding (JMVDC) scheme employs the correlation co-efficiency of the motion in texture and depth sequence in rendering the object of interest in the scene. Large amount of data that is produced in this representation becomes a challenge for data storage and network transmission. In JMVDC, the structure enables interlayer motion prediction mechanism by representing the base and enhancement layers as texture and depth. The inter-dependency of motion texture and depth content of multiview is accomplished and achieved by employing different correlation coefficient methods. The proposed method utilizes depth map to enhance the salient region with the combination of local and global saliency information. The experimental results show that the JMVDC method in saliency map with enhancement achieves the reduction of computational complexity to detect the distinctive region.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Y. Chen, Y.-K. Wang, K. Ugur, M. M. Hannuksela, J. Lainema, and M. Gabbouj, “The emerging MVC standard for 3D video services,” EURASIP Journal on Advances in Signal Processing, vol. 2009, ArticleID 78601513 pages 2009.

    Google Scholar 

  2. P. Merkle, A. Smolic, K. Müller, and T. Wiegand, “Multi-view video plus depth representation and coding,” Proc. of IEEE International Conference on Image Processing, vol. 1, pp. 201–204, Oct. 2007.

    Google Scholar 

  3. T. Wiegand, G. J. Sullivan, G. Bjøntegaard and A. Luthra, “Overview of the H.264/AVC video coding standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, no. 7, Jul. 2003.

    Google Scholar 

  4. H. Oh, Y.-S. Ho, “H.264-based depth map sequence coding Using Motion Information of Corresponding Texture Video,” Springer Berlin/Heidelberg, Advances in Image and Video Technology, vol. 4319, 2006.

    Google Scholar 

  5. C. Fehn, “Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV,” Proc. SPIE, vol. 5291, 93 (2004). https://doi.org/10.1117/12.524762.

  6. S. Tao, Y. Chen, M. M. Hannuksela, Y.-K. Wang, M. Gabbouj, and H. Li, “Joint texture and depth map video coding based on the scalable extension of H.264/AVC,” Proc. of IEEE International Symposium on Circuits and Systems, pp. 2353–2356, May 2009.

    Google Scholar 

  7. H. Schwarz, D. Marpe, and T. Wiegand, “Overview of the scalable video coding extension of the H.264/AVC standard,” IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, Sep. 2007.

    Google Scholar 

  8. Jun Zhang, Miska M. Hannuksela and Houqiang Li, “Joint Multiview Video Plus Depth Coding,” IEEE International Conference on Image Processing, vol. 10, Sep 2010.

    Google Scholar 

  9. L. Itti, “Models of bottom-up and top-down visual attention,” Ph.D. dissertation, Dept. Computat. Neur. Syst., California Inst. Technol, Pasadena, 2000.

    Google Scholar 

  10. L. Itti, C. Koch, and E. Niebur, “Model of saliency-based visual attention for rapid scene analysis,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254–1259, Nov. 1998.

    Google Scholar 

  11. Jun Xu, Xiaoqiang Guo, Qin Tu, Cuiwei Li and Aidong Men, “A Novel Video Saliency Map Detection Model In Compressed Domain,” Proc. Of IEEE Milcom 2015 in Communications, vol. 15, no. 9, Sep. 2015.

    Google Scholar 

  12. Wonjun Kim and J-J Han, “Video saliency detection using contrast of spatiotemporal directional coherence,” Signal Processing Letters, IEEE, vol. 21, no. 10, pp. 1250–1254, 2014.

    Google Scholar 

  13. Yuming Fang, Zhenzhong Chen, WeisiLin, Chia-Wen Lin,” Saliency Detection in the Compressed Domain for Adaptive Image Retargeting,” IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 21, NO. 9, SEPTEMBER 2012.

    Google Scholar 

  14. Imamoglu, N., W. Lin, and Y. Fang. “A Saliency Detection Model Using Low-Level Features Based on Wavelet Transform”, IEEE Transactions on Multimedia, 2012.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to T. Manasa Veena .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Manasa Veena, T., Satyanarayana, D., Giri Prasad, M.N. (2018). Joint Multiview Video Plus Depth Coding with Saliency Approach. In: Anguera, J., Satapathy, S., Bhateja, V., Sunitha, K. (eds) Microelectronics, Electromagnetics and Telecommunications. Lecture Notes in Electrical Engineering, vol 471. Springer, Singapore. https://doi.org/10.1007/978-981-10-7329-8_41

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-7329-8_41

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-7328-1

  • Online ISBN: 978-981-10-7329-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics