Abstract
We analyzed a light-field super-resolution problem in which, with a given set of multi-view images with a low resolution, the 3-D scene is reconstructed with a higher resolution using super-resolution (SR) reconstruction. The arrangement of the multi-view cameras is important because it determines the quality of the reconstruction. To simplify the analysis, we considered a situation in which a plane is located at a certain depth and a texture on that plane is super-resolved. We formulated the SR reconstruction process in the frequency domain, where the camera arrangement can be independently expressed as a matrix in the image formation model. We then evaluated the condition number of the matrix to quantify the quality of the SR reconstruction. We clarified that when the cameras are arranged in a regular grid, there exist singular depths in which the SR reconstruction becomes ill-posed. We also determined that this singularity can be avoided if the arrangement is randomly perturbed.
Chapter PDF
References
Baker, S., Kanade, T.: Limits on super-resolution and how to break them. IEEE Transactions on Pattern Analysis Machine Intelligence 24(9), 1167–1183 (2002)
Champagnat, F., Besnerais, G.L., Kulcsár, C.: Statistical performance modeling for superresolution: a discrete data-continuous reconstruction framework. Journal of the Optical Society of America A 26(7), 1730–1746 (2009)
Fukushima, N., Ishibashi, Y.: Free viewpoint image generation with super resolution. In: Picture Coding Symposium, pp. 1–4 (2010)
Mudenagudi, U., Gupta, A., Goel, L., Kushal, A., Kalra, P., Banerjee, S.: Super Resolution Of Images of 3D Scenecs. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) ACCV 2007, Part II. LNCS, vol. 4844, pp. 85–95. Springer, Heidelberg (2007)
Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine 20(3), 21–36 (2003)
Robinson, D., Milanfar, P.: Statistical performance analysis of super-resolution. IEEE Transactions on Image Processing 15(6), 1413–1428 (2006)
Takahashi, K., Naemura, T., Tanaka, M.: Rate-distortion analysis of super-resolution image/video decoding. In: International Conference on Image Processing (2011)
Tanaka, M., Okutomi, M.: Theoretical analysis on reconstruction-based super-resolution for an arbitrary PSF. In: IEEE Computer Vision and Pattern Recognition, vol. 2, pp. 947–954 (2005)
Tung, T., Nobuhara, S., Matsuyama, T.: Simultaneous super-resolution and 3d video using graph-cuts. In: IEEE Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nakashima, R., Takahashi, K., Naemura, T. (2011). Theoretical Analysis of Multi-view Camera Arrangement and Light-Field Super-Resolution. In: Ho, YS. (eds) Advances in Image and Video Technology. PSIVT 2011. Lecture Notes in Computer Science, vol 7087. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25367-6_36
Download citation
DOI: https://doi.org/10.1007/978-3-642-25367-6_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25366-9
Online ISBN: 978-3-642-25367-6
eBook Packages: Computer ScienceComputer Science (R0)