Skip to main content

OmniEye: A Spherical Omnidirectional Vision System to Sonify Robotic Trajectories in the AURAL Environment

  • Chapter
Artificial Intelligence Techniques for Computer Graphics

Part of the book series: Studies in Computational Intelligence ((SCI,volume 159))

Abstract

This paper describes the OmniEye, an omnidirectional vision system developed to track mobile robots in AURAL, a computational structured environment. AURAL aims to control the interaction between visual, sound and robotic information in a research for automatic and semi-automatic processes of artistic production. Different convex mirrors can be used to achieve an omnidirectional system. The use of a spherical mirror in this case introduces distortions in the image. A toolbox for the calibration of central omnidirectional cameras was used to obtain a first estimation for the imaging function. On a second step, a genetic algorithm was applied to adjust the coefficients of the imaging function. Experimental results and the application of the OmniEye for translating robotic paths into sound events in the AURAL environment are described.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Moroni, A., Von Zuben, F.J., Manzolli, J.: ArTbitration: Human-Machine Interaction in Artistic Domains. Leonardo 35(2), 185–188 (2002)

    Article  Google Scholar 

  2. Moroni, A.S., Manzolli, J., Von Zuben, F.: ArTbitrating JaVox: Evolution Applied to Visual and Sound Composition. In: Ibero-American Symposium in Computer Graphics, pp. 97–108 (2006)

    Google Scholar 

  3. Manzolli, J., Verschure, P.F.M.J.: Roboser: a Real-world Musical Composition System. Computer Music Journal 29(3), 55–74 (2005)

    Article  Google Scholar 

  4. Wassermann, K.C., Eng, K., Verschure, P.F.M.J., Manzolli, J.: Live Soundscape Composition Based on Synthetic Emotions. IEEE Multimedia 4, 82–90 (2003)

    Article  Google Scholar 

  5. Murray, J., Wermter, S., Erwin, H.: Auditory robotic tracking of sound sources using hybrid cross-correlation and recurrent networks. In: Proceedings of the International Conference on Intelligent Robots and Systems, pp. 3554–3559 (2005) doi: 10.1109/IROS.2005.1545093

    Google Scholar 

  6. Moroni, A., Cunha, S.: OmniEye: A Spherical Omnidirectional System for Tracking Robots in the AURAL Environment. In: Proceedings of the 11th Computer Graphics and Artificial Intelligence Conference, pp. 109–118 (2008)

    Google Scholar 

  7. Strelow, D.W., Singh, S.: Reckless motion estimation from omnidirectional image and inertial measurements (2003), http://www.cs.wustl.edu/~pless/omnivisFinal/Strelow.pdf (accessed October 22, 2007)

  8. Yagi, Y.: Omnidirectional sensing and its applications. IEICE Transactions on Information and Systems E82-D (3), 568–579 (1999)

    Google Scholar 

  9. Svoboda, T., Pajdla, T.: Epipolar Geometry for Central Catadioptric Cameras. International Journal of Computer Vision 49(1), 23–37 (2002)

    Article  MATH  Google Scholar 

  10. Mei, C., Rives, P.: Single View Point Omnidirectional Camera Calibration from Planar Grids. In: IEEE International Conference on Robotics and Automation, pp. 3945–3950 (2007)

    Google Scholar 

  11. Micusik, B., Pajdla, T.: Autocalibration & 3D Reconstruction with Noncentral Catadioptric Cameras. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. I-58–I-65 (2004)

    Google Scholar 

  12. Ying, X., Hu, Z.: Catadioptric Camera Calibration Using Geometric Invariants. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(10), 1260–1271 (2004)

    Article  Google Scholar 

  13. Ying, X., Hu, Z.: Can We Consider Central Catadioptric Cameras and Fisheye Cameras within a Unified Imaging Model? Eighth European Conference in Computer Vision. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3022, pp. 442–455. Springer, Heidelberg (2004)

    Google Scholar 

  14. Sturm, P., Ramaligam, S.: A Generic Concept for Camera Calibration. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3022, pp. 1–13. Springer, Heidelberg (2004)

    Google Scholar 

  15. Bakstein, H., Pajdla, T.: Panoramic mosaicing with a 180 field of view lens. In: Proceedings of the IEEE Workshop on Omnidirectional Vision, pp. 60–67 (2002)

    Google Scholar 

  16. Gluckman, J., Nayar, S.K.: Ego-motion and omnidirectional cameras. In: Sixth International Conference on Computer Vision. pp. 999–1005 (1998)

    Google Scholar 

  17. Scaramuzza, D., Martinelli, A., Siegwart, R.: A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion. In: Fourth IEEE International Conference on Computer Vision Systems ICVS 2006, pp. 45–45 (2006)

    Google Scholar 

  18. Scaramuzza, D.: Omnidirectional Camera Calibration Toolbox for Matlab (2008), http://asl.epfl.ch/~scaramuz/research/Davide_Scaramuzza_files/Research/OcamCalib_Tutorial.htm (accessed June 5, 2008)

  19. Holland, J.H.: Adaptation in Natural and Artificial Systems. University of Michigan Press (1975)

    Google Scholar 

  20. Michalewicz, Z.: Genetic Algorithms + Data Structures = Evolution Programs. Springer, Heidelberg (1996)

    MATH  Google Scholar 

  21. Comaniciu, D., Meer, P.: Robust Analysis of Feature Spaces: Color Image Segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 750–755 (1997)

    Google Scholar 

  22. Moroni, A., Manzolli, J., Von Zuben, F.J., Gudwin, R.: Vox Populi: An Interactive Evolutionary System for Algorithmic Music Composition. Leonardo Music Journal 10, 49–54 (2000)

    Article  Google Scholar 

  23. Moroni, A., Manzolli, J., Von Zuben, F.J., Gudwin, R.: Vox Populi: Evolutionary Computation for Music Evolution. In: Bentley, P., Corne, D. (eds.) Creative Evolutionary Systems, pp. 205–221. Morgan Kaufmann, San Francisco (2002)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Moroni, A., Cunha, S., Ramos, J., Manzolli, J. (2009). OmniEye: A Spherical Omnidirectional Vision System to Sonify Robotic Trajectories in the AURAL Environment. In: Plemenos, D., Miaoulis, G. (eds) Artificial Intelligence Techniques for Computer Graphics. Studies in Computational Intelligence, vol 159. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85128-8_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-85128-8_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-85127-1

  • Online ISBN: 978-3-540-85128-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics