Advertisement

Journal of Real-Time Image Processing

, Volume 15, Issue 4, pp 725–738 | Cite as

Real-time correction of panoramic images using hyperbolic Möbius transformations

  • Luis Peñaranda
  • Luiz Velho
  • Leonardo Sacht
Original Research Paper
  • 128 Downloads

Abstract

Wide-angle images gained a huge popularity in the last years due to the development of computational photography and imaging technological advances. They present the information of a scene in a way which is more natural for the human eye but, on the other hand, they introduce artifacts such as bent lines. These artifacts become more and more unnatural as the field of view increases. In this work, we present a technique aimed to improve the perceptual quality of panorama visualization. The main ingredients of our approach are, on one hand, considering the viewing sphere as a Riemann sphere, what makes natural the application of Möbius (complex) transformations to the input image, and, on the other hand, a projection scheme which changes in function of the field of view used. We also introduce an implementation of our method, compare it against images produced with other methods and show that the transformations can be done in real time, which makes our technique very appealing for new settings, as well as for existing interactive panorama applications.

Keywords

Panorama Perspective projection Möbius transformation Real time Implementation 

Notes

Acknowledgments

The authors thank the Flickr and Wikimedia Commons users who made available their equirectangular images under the Creative Commons license, used to obtain some figures of the paper: Gadl (Figs. 6, 10, 11, 12), Luca Biada (Fig. 7), DXR (Fig. 8) and HamburgerJung (Fig. 9). L. Sacht acknowledges the doctoral scholarship from CNPq. L. Peñaranda acknowledges financial support from IMPA during years 2012 to 2014.

Supplementary material

Supplementary material 1 (mp4 23413 KB)

References

  1. 1.
    D’Angelo, P., et al.: Hugin—panorama photo stitcher, version 2014.0.0. http://hugin.sourceforge.net. Accessed 24 March 2015
  2. 2.
    Pfeil, J., Hildebrand, K., Gremzow, C., Bickel, B., Alexa, M.: Throwable panoramic ball camera. In: SIGGRAPH Asia 2011 Emerging Technologies, SA ’11, pp. 4:1. ACM (2011)Google Scholar
  3. 3.
    Kingslake, R.: A History of the Photographic Lens. Academic Press, London (1989)Google Scholar
  4. 4.
    Zorin, D., Barr, A.H.: Correction of geometric perceptual distortions in pictures. In: 22nd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’95, pp. 257–264, New York. ACM (1995)Google Scholar
  5. 5.
    Carroll, R., Agrawal, M., Agarwala, A.: Optimizing content-preserving projections for wide-angle images. ACM Trans. Graph. 28(3), 43:1–43:9 (2009)CrossRefGoogle Scholar
  6. 6.
    Sacht, L.: Content-based projections for panoramic images and videos. Master’s thesis, IMPA (2010)Google Scholar
  7. 7.
    Sacht, L., Velho, L.: Complex plane transformations for manipulation and visualization of panoramas. In: International Conference on Computer Graphics Theory and Applications (GRAPP 2013) (2013)Google Scholar
  8. 8.
    Zelnik-Manor, L., Peters, G., Perona, P.: Squaring the circles in panoramas. In: 10th IEEE International Conference on Computer Vision, vol. 2, ICCV ’05, pp. 1292–1299, Washington. IEEE (2005)Google Scholar
  9. 9.
    Sharpless, T.K., Postle, B., Germán, D.M.: Pannini: a new projection for rendering wide angle perspective images. In: 6th International Conference on Computational Aesthetics in Graphics, Visualization and Imaging, Computational Aesthetics’10, pp. 9–16. Aire-la-Ville, Switzerland. Eurographics Association (2010)Google Scholar
  10. 10.
    Germán, D.M., Burchill, L., Duret-Lutz, A., Pérez-Duarte, S., Pérez-Duarte, E., Sommers, J.: Flattening the viewable sphere. In: 3rd Eurographics Conference on Computational Aesthetics in Graphics, Visualization and Imaging, Computational Aesthetics ’07, pp. 23–28. Eurographics (2007)Google Scholar
  11. 11.
    Kopf, J., Lischinski, D., Deussen, O., Cohen-Or, D., Cohen, M.: Locally adapted projections to reduce panorama distortions. Comput. Graph. Forum 28(4), 1083–1089 (2009)CrossRefGoogle Scholar
  12. 12.
    Wei, J., Li, C.-F., Shi-Min, H., Martin, R.R., Tai, C.-L.: Fisheye video correction. IEEE Trans. Vis. Comput. Graph. 18(10), 1771–1783 (2012)CrossRefGoogle Scholar
  13. 13.
    Kopf, J., Uyttendaele, M., Deussen, O., Cohen, M.F.: Capturing and viewing gigapixel images. ACM Trans. Graph. 26(3) (2007)Google Scholar
  14. 14.
    Snyder, J.P.: Map Projections-A Working Manual, vol. 1395 of Geological Survey Bulletin Series. U.S. G.P.O. (1987)Google Scholar
  15. 15.
    Needham, T.: Visual Complex Analysis. Clarendon Press (1997)Google Scholar
  16. 16.
    Cambridge in colour: Cameras vs. the human eye. http://www.cambridgeincolour.com/tutorials/cameras-vs-human-eye.htm. Accessed 24 Sept 2013
  17. 17.
    Ware, C.: Information Visualization: Perception for Design, 2nd edn. Morgan Kaufman, Massachusetts (2004)Google Scholar
  18. 18.
    Milnor, J.: A problem in cartography. Am. Math. Mon. 76(10), 1101–1112 (1969)MathSciNetCrossRefGoogle Scholar
  19. 19.
    Stein, W.A., et al.: Sage Mathematics Software (Version 5.7). The Sage Development Team (2013). http://www.sagemath.org. Accessed 9 Sept 2013
  20. 20.
    Dersch, H., et al.: Panorama tools, version 2.9.19. http://panotools.sourceforge.net. Accessed 24 March 2015
  21. 21.
    Sharpless, T.: Panini perspective tool, version 0.71.104. http://pvqt.sourceforge.net. Accessed 24 March 2015
  22. 22.
    Google street view. http://www.google.com/streetview. Accessed 24 March 2015
  23. 23.
    Anguelov, D., Dulong, C., Filip, D., Frueh, C., Lafon, S., Lyon, R., Ogale, A., Vincent, L., Weaver, J.: Google street view: capturing the world at street level. Computer 43 (2010)Google Scholar
  24. 24.
    Bourke, P.D.: Spherical mirror: a new approach to hemispherical dome projection. In: 3rd International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia, pp. 281–284. ACM (2005)Google Scholar
  25. 25.
    Bourke, P.D., Felinto, D.Q.: Blender and immersive gaming in a hemispherical dome. In: Computer Games, Multimedia and Allied Technology Conference (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  1. 1.Instituto Nacional de Matemática Pura e Aplicada (IMPA)Rio de JaneiroBrazil
  2. 2.Universidade Federal do Rio de Janeiro (UFRJ)Rio de JaneiroBrazil
  3. 3.Universidade Federal de Santa Catarina (UFSC)FlorianópolisBrazil

Personalised recommendations