Light Field Retrieval via Focus Variation

  • Runnan Zhang
  • Jiasong Sun
  • Chao ZuoEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11902)


Light field imaging is a new computational imaging method in recent years, which is a representation of full four-dimensional (4D) radiance of all rays with spatial and angular information in free space. However, most current light field imaging systems are limited by the contradiction between spatial resolution and angular resolution, that is, trading spatial resolution for angular resolution. In this paper, we present a full resolution light field microscopy technique based on 3D intensity transport. The advantage of our method is that it does not sacrifice spatial resolution, and the reconstructed light field is of full resolution, comparable to that of the image sensor itself. First, a non-linear iterative reconstruction algorithm is proposed to reconstruct the full resolution light field from the 3D intensity stack which is captured by axial scanning. Then, we investigate the key factors that influence the quality of the reconstructed 4D light field, which is proved to be related to the number of reconstructed viewing angles and the number of captured images of each stack. Finally, experiments are carried out with real 3D samples, and the above methods are tested and evaluated with simple two-layer samples and complex multi-layer samples as Cyclops and Drosophila. The reliability and accuracy of our method are verified by simulation and experimental results.


Light field microscopy imaging Three-dimensional intensity transport Nonlinear optimization 


  1. 1.
    Lippmann, G.: Reversible prints integral photographs. Acad. Sci. 7, 821–825 (1908)Google Scholar
  2. 2.
    Gershun, A.: The light field. J. Math. Phys. 18, 51–151 (1939)CrossRefGoogle Scholar
  3. 3.
    Levoy, M., Hanrahan, P.: Light field rendering. In: Proceedings of SIGGRAPH. ACM Press, New York, pp. 31–42 (1996)Google Scholar
  4. 4.
    Adelson, E., Wang, Y.A.: Single lens stereo with a plenoptic camera. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 99–106 (1992)CrossRefGoogle Scholar
  5. 5.
    Levoy, M., Ng, R., Adams, A.: Light field microscopy. Proc. SIGGRAPH 25(3), 924–934 (2006)CrossRefGoogle Scholar
  6. 6.
    Ng, R., Levoy, M., Bredif, M.: Light field photography with a hand-held plenoptic camera. Technical Report CSTR. Stanford Computer Science Tech Report CSTR (2005)Google Scholar
  7. 7.
    Georgiev, T., Intwala, C., Goma, S.: Light field camera design for integral view photography. Adobe Technical Report (2006)Google Scholar
  8. 8.
    Wilburn, B., Joshi, N., Vaish, V., et al.: High performance imaging using large camera arrays. Proc. SIGGRAPH 05, 765–776 (2005)CrossRefGoogle Scholar
  9. 9.
    Zuo, C., Sun, J., Feng, S., et al.: Programmable aperture microscopy: a computational method for multi-modal phase contrast and light field imaging. Opt. Lasers Eng. 80, 24–31 (2016)CrossRefGoogle Scholar
  10. 10.
    Marwah, K., Wetzstein, G., Bando, Y., et al.: Compressive light field photography using overcomplete dictionaries and optimized projections. ACM Trans. Graph. 32(4), 1–12 (2013)CrossRefGoogle Scholar
  11. 11.
    Liang, C.K., Liu, G., Chen, H.: Light field acquisition using programmable aperture camera. In: Proceedings of IEEE International Conference on Image Processing. IEEE Press, Washington DC, vol. 5, pp. 233–236 (2007)Google Scholar
  12. 12.
    Yin, X., Wang, G., Li, W., Liao, Q.: Iteratively reconstructing 4D light fields from focal stacks. Appl. Opt. 55(30), 8457–8463 (2016)CrossRefGoogle Scholar
  13. 13.
    Liu, C., Qiu, J., Jiang, M.: Light field reconstruction from projection modeling of focal stack. Opt. Express 25(10), 11377–11388 (2017)CrossRefGoogle Scholar
  14. 14.
    Zuo, C., Chen, Q., Tian, L., et al.: Transport of intensity phase retrieval and computational imaging for partially coherent fields: The phase space perspective. Opt. Lasers Eng. 71, 20–32 (2015)CrossRefGoogle Scholar
  15. 15.
    Zuo, C., Chen, Q., Asundi, A.: Light field moment imaging: comment. Opt. Lett. 39, 3 (2014)CrossRefGoogle Scholar
  16. 16.
    Chen, N., Ren, Z., Li, D., et al.: Analysis of the noise in back projection light field acquisition and its optimization. Appl. Opt. 56(13), 20–26 (2017)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.School of Electronic and Optical EngineeringNanjing University of Science and TechnologyNanjingChina
  2. 2.Smart Computational Imaging (SCI) LaboratoryNanjing University of Science and TechnologyNanjingChina
  3. 3.Jiangsu Key Laboratory of Spectral Imaging and Intelligent SenseNanjing University of Science and TechnologyNanjingChina

Personalised recommendations