Advertisement

Fun with Asynchronous Vision Sensors and Processing

  • Tobi Delbruck
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7583)

Abstract

This paper provides a personal perspective on our group’s efforts in building event-based vision sensors, algorithms, and applications over the period 2002-2012. Some recent advances from other groups are also briefly described.

Keywords

Vision Sensor Voltage Gain CMOS Image Sensor Active Pixel Sensor Capacitive Divider 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Mahowald, M.A.: An Analog VLSI System for Stereoscopic Vision. Kluwer, Boston (1994)CrossRefGoogle Scholar
  2. 2.
    Lichtsteiner, P., Posch, C., Delbruck, T.: A 128×128 120 dB 15 μs latency asynchronous temporal contrast vision sensor. IEEE Journal of Solid-State Circuits 43(2), 566–576 (2008)CrossRefGoogle Scholar
  3. 3.
    Dynamic Vision Sensor (DVS) - asynchronous temporal contrast silicon retina (2012), http://siliconretina.ini.uzh.ch
  4. 4.
    Conradt, J., Berner, R., Cook, M., Delbruck, T.: An Embedded AER Dynamic Vision Sensor for Low-Latency Pole Balancing. In: 5th IEEE Workshop on Embedded Computer Vision (in conjunction with ICCV 2009), Kyoto, Japan, pp. 1–6. IEEE (2009)Google Scholar
  5. 5.
    Delbruck, T.: Frame-free dynamic digital vision. In: Proceedings of Intl. Symp. on Secure-Life Electronics, Advanced Electronics for Quality Life and Society, Tokyo, University of Tokyo, pp. 21–26 (2008)Google Scholar
  6. 6.
    Delbruck, T., Lichtsteiner, P.: Fast sensory motor control based on event-based hybrid neuromorphic-procedural system. In: ISCAS 2007, New Orleans, pp. 845–848 (2007)Google Scholar
  7. 7.
    Berner, R., Delbruck, T.: Event-Based Pixel Sensitive to Changes of Color and Brightness. IEEE Transactions on Circuits and Systems I: Regular Papers 58(7), 1581–1590 (2011)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Delbruck, T., Linares-Barranco, B., Culurciello, E., Posch, C.: Activity-Driven, Event-Based Vision Sensors. In: IEEE International Symposium on Circuits and Systems, Paris, pp. 2426–2429 (2010)Google Scholar
  9. 9.
    Liu, S.C., Delbruck, T.: Neuromorphic sensory systems. Current Opinion in Neurobiology 20(3), 288–295 (2010)CrossRefGoogle Scholar
  10. 10.
    Liu, S.C., van Schaik, A., Minch, B.A., Delbruck, T.: Event-based 64-channel binaural silicon cochlea with Q enhancement mechanisms. In: IEEE ISCAS 2009, pp. 2426–2429 (2010)Google Scholar
  11. 11.
    jAER open source project: Real time sensory-motor processing for event-based sensors and systems, (2007), http://jaer.wiki.sourceforge.net
  12. 12.
    Seebetter project (2011), http://www.seebetter.eu
  13. 13.
    Serrano-Gotarredona, R., Oster, M., et al.: CAVIAR: A 45k Neuron, 5M Synapse, 12G Connects/s AER Hardware Sensory–Processing– Learning–Actuating System for High-Speed Visual Object Recognition and Tracking. IEEE Trans. on Neural Networks 20(9), 1417–1438 (2009)CrossRefGoogle Scholar
  14. 14.
    Abshire, P., et al.: Confession session: Learning from others mistakes. In: ISCAS 2011, Rio de Janeiro, pp. 1149–1162 (2011)Google Scholar
  15. 15.
    Rogister, P., Benosman, R., Ieng, S.-H., Lichtsteiner, P., Delbruck, T.: Asynchronous Event-Based Binocular Stereo Matching. IEEE Transactions on Neural Networks and Learning Systems 23(2), 347–353 (2012)CrossRefGoogle Scholar
  16. 16.
    Benosman, R., Sio, H., Ieng, X., Rogister, P., Posch, C.: Asynchronous Event-Based Hebbian Epipolar Geometry. IEEE Transactions on Neural Networks 22(11), 1723–1734 (2011)CrossRefGoogle Scholar
  17. 17.
    Matolin, D., Posch, C., Wohlgenannt, R.: True correlated double sampling and comparator design for time-based image sensors. In: ISCAS 2009 (2009)Google Scholar
  18. 18.
    Posch, C., Matolin, D., Wohlgenannt, R.: A QVGA 143dB dynamic range asynchronous address-event PWM dynamic image sensor with lossless pixel-level video compression. In: 2010 IEEE Solid-State Circuits Conference Digest of Technical Papers, ISSCC (2010)Google Scholar
  19. 19.
    Camunas-Mesa, L., Zamarreno-Ramos, C., Linares-Barranco, A., Acosta-Jimenez, A.J., Serrano-Gotarredona, T., Linares-Barranco, B.: An Event-Driven Multi-Kernel Convolution Processor Module for Event-Driven Vision Sensors. IEEE Journal of Solid-State Circuits 47(2), 504–517 (2012)CrossRefGoogle Scholar
  20. 20.
    Landolt, O., Mitros, A., Koch, C.: Visual sensor with resolution enhancement by mechanical vibrations. In: Advanced Research in VLSI, 2001. Proceedings of ARVLSI 2001, pp. 249–264 (2001)Google Scholar
  21. 21.
    Drazen, D., Lichtsteiner, P., Hafliger, P., Delbruck, T., Jensen, A.: Toward real-time particle tracking using an event-based dynamic vision sensor. Experiments in Fluids 51(5), 1465–1469 (2011)CrossRefGoogle Scholar
  22. 22.
    Lee, J., Delbruck, T., Park, P.K.J., Pfeiffer, M., Shin, C.W., Ryu, H., Kang, B.C.: Live demonstration: Gesture-Based remote control using stereo pair of dynamic vision sensors. In: ISCAS 2012, Seoul (in press, 2012)Google Scholar
  23. 23.
    Yang, M., Liu, S.C., Li, C., Delbruck, T.: Addressable Current Reference Array with 170dB Dynamic Range. In: ISCAS 2012, Seoul (in press, 2012)Google Scholar
  24. 24.
    Boahen, K.A.: A burst-mode word-serial address-event link-I transmitter design. IEEE Transactions on Circuits and Systems I-Regular Papers 51(7), 1269–1280 (2004)CrossRefGoogle Scholar
  25. 25.
    Jimenez-Fernandez, A., Fuentes-del-Bosh, J.L., Paz-Vicente, R., Linares-Barranco, A., Jiménez, G.: Live demonstration: Neuro-inspired system for realtime vision tilt correction. In: ISCAS 2010, pp. 1393–1397 (2010)Google Scholar
  26. 26.
    Lenero-Bardallo, J.A., Serrano-Gotarredona, T., Linares-Barranco, B.: A 3.6 us Latency Asynchronous Frame-Free Event-Driven Dynamic-Vision-Sensor. IEEE Journal of Solid-State Circuits 46(6), 1443–1455 (2011)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Tobi Delbruck
    • 1
  1. 1.Inst. of NeuroinformaticsUniversity of Zurich and ETH ZurichSwitzerland

Personalised recommendations