# Real-time correction of panoramic images using hyperbolic Möbius transformations

## Abstract

Wide-angle images gained a huge popularity in the last years due to the development of computational photography and imaging technological advances. They present the information of a scene in a way which is more natural for the human eye but, on the other hand, they introduce artifacts such as bent lines. These artifacts become more and more unnatural as the field of view increases. In this work, we present a technique aimed to improve the perceptual quality of panorama visualization. The main ingredients of our approach are, on one hand, considering the viewing sphere as a Riemann sphere, what makes natural the application of Möbius (complex) transformations to the input image, and, on the other hand, a projection scheme which changes in function of the field of view used. We also introduce an implementation of our method, compare it against images produced with other methods and show that the transformations can be done in real time, which makes our technique very appealing for new settings, as well as for existing interactive panorama applications.

## Keywords

Panorama Perspective projection Möbius transformation Real time Implementation## Notes

### Acknowledgments

The authors thank the Flickr and Wikimedia Commons users who made available their equirectangular images under the Creative Commons license, used to obtain some figures of the paper: Gadl (Figs. 6, 10, 11, 12), Luca Biada (Fig. 7), DXR (Fig. 8) and HamburgerJung (Fig. 9). L. Sacht acknowledges the doctoral scholarship from CNPq. L. Peñaranda acknowledges financial support from IMPA during years 2012 to 2014.

## Supplementary material

Supplementary material 1 (mp4 23413 KB)

## References

- 1.D’Angelo, P., et al.: Hugin—panorama photo stitcher, version 2014.0.0. http://hugin.sourceforge.net. Accessed 24 March 2015
- 2.Pfeil, J., Hildebrand, K., Gremzow, C., Bickel, B., Alexa, M.: Throwable panoramic ball camera. In: SIGGRAPH Asia 2011 Emerging Technologies, SA ’11, pp. 4:1. ACM (2011)Google Scholar
- 3.Kingslake, R.: A History of the Photographic Lens. Academic Press, London (1989)Google Scholar
- 4.Zorin, D., Barr, A.H.: Correction of geometric perceptual distortions in pictures. In: 22nd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’95, pp. 257–264, New York. ACM (1995)Google Scholar
- 5.Carroll, R., Agrawal, M., Agarwala, A.: Optimizing content-preserving projections for wide-angle images. ACM Trans. Graph.
**28**(3), 43:1–43:9 (2009)CrossRefGoogle Scholar - 6.Sacht, L.: Content-based projections for panoramic images and videos. Master’s thesis, IMPA (2010)Google Scholar
- 7.Sacht, L., Velho, L.: Complex plane transformations for manipulation and visualization of panoramas. In: International Conference on Computer Graphics Theory and Applications (GRAPP 2013) (2013)Google Scholar
- 8.Zelnik-Manor, L., Peters, G., Perona, P.: Squaring the circles in panoramas. In: 10th IEEE International Conference on Computer Vision, vol. 2, ICCV ’05, pp. 1292–1299, Washington. IEEE (2005)Google Scholar
- 9.Sharpless, T.K., Postle, B., Germán, D.M.: Pannini: a new projection for rendering wide angle perspective images. In: 6th International Conference on Computational Aesthetics in Graphics, Visualization and Imaging, Computational Aesthetics’10, pp. 9–16. Aire-la-Ville, Switzerland. Eurographics Association (2010)Google Scholar
- 10.Germán, D.M., Burchill, L., Duret-Lutz, A., Pérez-Duarte, S., Pérez-Duarte, E., Sommers, J.: Flattening the viewable sphere. In: 3rd Eurographics Conference on Computational Aesthetics in Graphics, Visualization and Imaging, Computational Aesthetics ’07, pp. 23–28. Eurographics (2007)Google Scholar
- 11.Kopf, J., Lischinski, D., Deussen, O., Cohen-Or, D., Cohen, M.: Locally adapted projections to reduce panorama distortions. Comput. Graph. Forum
**28**(4), 1083–1089 (2009)CrossRefGoogle Scholar - 12.Wei, J., Li, C.-F., Shi-Min, H., Martin, R.R., Tai, C.-L.: Fisheye video correction. IEEE Trans. Vis. Comput. Graph.
**18**(10), 1771–1783 (2012)CrossRefGoogle Scholar - 13.Kopf, J., Uyttendaele, M., Deussen, O., Cohen, M.F.: Capturing and viewing gigapixel images. ACM Trans. Graph.
**26**(3) (2007)Google Scholar - 14.Snyder, J.P.: Map Projections-A Working Manual, vol. 1395 of Geological Survey Bulletin Series. U.S. G.P.O. (1987)Google Scholar
- 15.Needham, T.: Visual Complex Analysis. Clarendon Press (1997)Google Scholar
- 16.Cambridge in colour: Cameras vs. the human eye. http://www.cambridgeincolour.com/tutorials/cameras-vs-human-eye.htm. Accessed 24 Sept 2013
- 17.Ware, C.: Information Visualization: Perception for Design, 2nd edn. Morgan Kaufman, Massachusetts (2004)Google Scholar
- 18.Milnor, J.: A problem in cartography. Am. Math. Mon.
**76**(10), 1101–1112 (1969)MathSciNetCrossRefGoogle Scholar - 19.Stein, W.A., et al.: Sage Mathematics Software (Version 5.7). The Sage Development Team (2013). http://www.sagemath.org. Accessed 9 Sept 2013
- 20.Dersch, H., et al.: Panorama tools, version 2.9.19. http://panotools.sourceforge.net. Accessed 24 March 2015
- 21.Sharpless, T.: Panini perspective tool, version 0.71.104. http://pvqt.sourceforge.net. Accessed 24 March 2015
- 22.Google street view. http://www.google.com/streetview. Accessed 24 March 2015
- 23.Anguelov, D., Dulong, C., Filip, D., Frueh, C., Lafon, S., Lyon, R., Ogale, A., Vincent, L., Weaver, J.: Google street view: capturing the world at street level. Computer
**43**(2010)Google Scholar - 24.Bourke, P.D.: Spherical mirror: a new approach to hemispherical dome projection. In: 3rd International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia, pp. 281–284. ACM (2005)Google Scholar
- 25.Bourke, P.D., Felinto, D.Q.: Blender and immersive gaming in a hemispherical dome. In: Computer Games, Multimedia and Allied Technology Conference (2010)Google Scholar