Abstract
In this paper, a parallel system together with a real-time workload balancing algorithm is proposed for view synthesis on multi-core platforms. First, a numerical relationship between the number of holes after warping and the work-load of view synthesis is derived based on correlation analysis for the texture regions. Then, according to the difference between the adjacent depth maps, a novel model is proposed to predict the synthesis workload accurately. Experimental results show that the workload difference among cores is reduced obviously and higher speedup ratio is achieved with negligible quality degradation by applying the proposed workload balancing system.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Tanimoto, M., Tehrani, M.P., Fujii, T., Yendo, T.: Free-Viewpoint TV. In: Signal Processing Magazine. IEEE, vol. 28, no. 3, pp. 67–76 (2011)
Tech, G., Wegner, K., Chen, Y., Yea, S.: 3D-HEVC test model 5. In: JCT-3 V Doc. JTC3 V-E1005, 5th Meeting, Vienna (2013)
Fehn, C.: A 3D-TV approach using depth-image-based rendering (DIBR). In: Proceedings of VIIP, Benalmádena, vol. 3, pp. 84–88 (2003)
Jung, J.I., Ho, Y.S.: Parallel view synthesis programming for free viewpoint television. In: 2012 IEEE International Conference on Signal Processing, Communication and Computing, Hongkong, pp. 88–91 (2012)
Shin, H.C., Kim, Y.J., Park, H., Park, J.I.: Fast view synthesis using GPU for 3D display. IEEE Trans. Consum. Electron. 54(4), 2068–2076 (2008)
Sihn, K.H., Baik, H., Kim, J.T., Bae, S., Song, H.J.: Novel approaches to parallel H.264 decoder on symmetric multicore systems. In: IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, pp.2017–2020 (2009)
Pering, T., Burd, T., Brodersen, R.: The simulation and evaluation of dynamic voltage scaling algorithms. In: International Symposium on Low Power Electronics and Design, Monterey, pp. 76–81 (1998)
Jin, X., Goto, S.: Hilbert transform based workload prediction and dynamic frequency scaling for power efficient video encoding. IEEE Trans. CAD Integr. Circ. Syst. 31(5), 649–661 (2012)
Sinha, A., Chandrakasan, A.P.: Dynamic voltage scheduling using adaptive filtering of workload traces. In: Fourteenth International Conference on VLSI Design, pp. 221–226. IEEE, Bangalore (2001)
Sung, Y.S., Hosik, S., Ju, J.Y., Man, R.Y.: Inter-view consistent hole filling in view extrapolation for multi-view image generation. In: IEEE International Conference on Image Processing, Paris, pp. 2883–2887 (2014)
View Synthesis Reference Software (VSRS 3.5) in Technical report ISO/IEC JTC1/SC29/WG11, Guangzhou (2010)
3D Video Databse in Mobile 3DTV. http://sp.cs.tut.fi/mobile3dtv/stereo-video/
MPEG-FTV Test Sequence. http://www.tanimoto.nuee.nagoyau.ac.jp/mpeg/
Rusanovskyy, D., Müller, K., Vetro, A.: Common test conditions of 3DV core experiments. In: JCT-3 V Doc. JCT3 V-D1100, 4th meeting, Stockholm (2012)
Rodgers, D.P.: Improvements in multiprocessor system design. ACM SIGARCH Comput. Architect. News Arch. 13(3), 225–231 (1985)
Acknowledgment
This work was supported by project of NSFC 61371138, China.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Liu, Z., Jin, X., Dai, Q. (2015). Motion and Depth Assisted Workload Prediction for Parallel View Synthesis. In: Ho, YS., Sang, J., Ro, Y., Kim, J., Wu, F. (eds) Advances in Multimedia Information Processing -- PCM 2015. PCM 2015. Lecture Notes in Computer Science(), vol 9315. Springer, Cham. https://doi.org/10.1007/978-3-319-24078-7_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-24078-7_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24077-0
Online ISBN: 978-3-319-24078-7
eBook Packages: Computer ScienceComputer Science (R0)