Depth Map Up-Sampling Using Random Walk

  • Gyo-Yoon Lee
  • Yo-Sung Ho
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7087)


For the high quality three-dimensional broadcasting, depth maps are important data. Although commercially available depth cameras capture high-accuracy depth maps in real time, their resolutions are much smaller than those of the corresponding color images due to technical limitations. In this paper, we propose the depth map up-sampling method using a high-resolution color image and a low-resolution depth map. The proposed method is appropriate to match boundaries between the color image and the depth map. Experimental results show that our method enhances the depth map resolution successfully.


3D broadcasting multi-view video FTV TOF cameras depth map interpolation random walk 


  1. 1.
    Kauff, P., Atzpadin, N., Fehn, C., Muller, M., Schreer, O., Smolic, A., Tanger, R.: Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability. Signal Processing: Image Communication 22(2), 217–234 (2007)Google Scholar
  2. 2.
    Nayar, S.K., Nakagawa, Y.: Shape from focus. IEEE Transactions on Pattern Analysis and Machine Intelligence 16(8), 824–831 (1994)CrossRefGoogle Scholar
  3. 3.
    Zitnick, C., Kang, S., Uyttendaele, M., Winder, S., Szeliski, R.: High-quality video view interpolation using a layered representation. In: Proceedings of ACM SIGGRAPHS, vol. 23(3), pp. 600–608 (2004)Google Scholar
  4. 4.
    Scharstein, D., Szeliski, R.: High-accuracy stereo depth maps using structured light. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 195–202 (2003)Google Scholar
  5. 5.
    Iddan, G., Yahav, G.: 3D imaging in the studio and elsewhere. In: Proceedings of SPIE Videometrics and Optical Methods for 3D Shape Measurements, vol. 4298, pp. 48–55 (2001)Google Scholar
  6. 6.
    Lee, E., Ho, Y.: Generation of high-quality depth maps using hybrid camera system for 3-D video. Journal of Visual Communication and Image Representation 22, 73–84 (2011)CrossRefGoogle Scholar
  7. 7.
    Jung, J., Ho, Y.: MRF-based Depth Map Interpolation using Color Segmentation. In: Asia-Pacific Signal and Information Processing Association, pp. 19–22 (2010)Google Scholar
  8. 8.
    Press, W., Teukolsky, S., Vetterling, W., Flannery, B.: Numerical Recipes in C: The art of Scientific Computing. Cambridge University Press (1992)Google Scholar
  9. 9.
    Diebel, J., Thrun, S.: An application of Marko random fields to range sensing. In: Advances in Neural Information Processing Systems, vol. 18, pp. 291–298 (2005)Google Scholar
  10. 10.
    Johannes, K., Michael, C., Dani, L., Matt, U.: Joint Bilateral Upsampling. In: Proceedings of ACM SIGGRAPHS, vol. 26(3) (2007)Google Scholar
  11. 11.
    Yang, Q., Yang, R., Davis, J., Nister, D.: Spatial-depth super resolution for range images. In: International Conference on Computer Vision and Pattern Recognition (2007)Google Scholar
  12. 12.
    Zhang, Z.: A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 1330–1334 (2000)CrossRefGoogle Scholar
  13. 13.
    Camera Calibration Toolbox Program for Matlab provided by Caltech,
  14. 14.
    Gardy, L.: Random Walks for Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(11) (2006)Google Scholar
  15. 15.
    Kakutani, S.: Markov processes and the Dirichlet problem. Proc. Jap. Acad. 21, 227–233 (1945)CrossRefzbMATHGoogle Scholar
  16. 16.
    Biggs, N.: Algebraic potential theory on graphs. Bulletin of London Mathematics Society 29, 641–682 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  17. 17.
    Courant, R., Hilbert, D.: Methods of Mathematical Physics, vol. 2. John Wiley and Sons (1989)Google Scholar
  18. 18.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Gyo-Yoon Lee
    • 1
  • Yo-Sung Ho
    • 1
  1. 1.Gwnagju Institute of Science and Technology (GIST)GwangjuRepublic of Korea

Personalised recommendations