Abstract
In this paper, we present a multi-robot system that integrates a vision based navigation system with a non-speech-based audio system for the purpose of sorting objects. Here we use two separate robotic systems each utilizing a different sensor type: video and audio. We propose using vision-based sensors with audio based sensors because a single sensor such as a video sensor may not understand the entire environment. Additionally, robots can come to inaccurate conclusions based on their observations so we increase the accuracy of the system by interpreting the input from multiple robots using cognitive sharing. Therefore, cooperation of multiple robots using multiple sensors provides a better understanding of the environment. The results show the effectiveness of the multi-robot cognitive sharing system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Badali, A., Valin, J., Michaud, F., Aarabi, P.: Evaluating Real-time Audio Localization Algorithms for Artificial Audition in Robotics. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2033–2038 (2009)
Bradski, G.R., Kaehler, A.: Learning OpenCV: Computer vision with the OpenCV library. O’Reilly Press, Cambridge (2008)
Cowling, M.: Non-speech environmental sound classification system for autonomous surveillance. Ph.D. Thesis, Griffith University, Gold Coast Campus, School of Information Technology (2004)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley Interscience (2004)
Ellis, D.: Dynamic Time Warp (DTW) in Matlab (2003), http://www.ee.columbia.edu/dpwe/resources/matlab/dtw/
Gohring, D., Homann, J.: Multi Robot Object Tracking and Self Localization Using Visual Percept Relations. In: Proceedings of IEEE/RSJ International Conference of Intelligent Robots and Systems, pp. 31–36 (2006)
Hashimoto, T.: Birth in the real world 3D Character! Introduction to Programming ARToolKit Augmented Reality. ASCII Media Works (2008)
McGibney, D., Umeda, T., Sekiyama, K., Mukai, H., Fukuda, T.: Cooperative Distributed Object Classification for Multiple Robots with Audio Features. In: IEEE International Symposium on Micro-NanoMechatronics and Human Science, pp.134–139 (2011)
Slaney, M.: Auditory Toolbox. Interval Research Corporation, version 2 (1998), https://engineering.purdue.edu/~malcolm/interval/1998-010/AuditoryToolboxTechReport.pdf
Stiefelhagen, R., Bernardin, K., Bowers, R., Garofolo, J., Mostefa, D., Soundararajan, P.: The CLEAR 2006 Evaluation. In: Stiefelhagen, R., Garofolo, J.S. (eds.) CLEAR 2006. LNCS, vol. 4122, pp. 1–44. Springer, Heidelberg (2007)
Stiefelhagen, R., Bernardin, K., Bowers, R., Rose, R.T., Michel, M., Garofolo, J.S.: The CLEAR 2007 Evaluation. In: Stiefelhagen, R., Bowers, R., Fiscus, J.G. (eds.) RT 2007 and CLEAR 2007. LNCS, vol. 4625, pp. 3–34. Springer, Heidelberg (2008)
Takahashi, J., Sekiyama, K., Fukuda, T.: Cooperative Object Tracking with Mobile Robotic Sensor Network. Distributed Autonomous Robotic Systems 8, 51–62 (2008)
Tan, K.G., Wasif, A.R., Tan, C.P.: Objects Tracking Utilizing Square Grid Rfid Reader Antenna Network. Journal of Electromagnetic Waves and Applications 22(12), 27–38 (2008)
Theodoridis, S., Koutroumbas, K.: Pattern Recognition. Academic Press (2009)
Theodoridis, S., Pikrakis, A., Koutroumbas, K., Cavouras, D.: Introduction to pattern recognition: a MATLAB approach. Academic Press (2010)
Turetsky, R., Ellis, D.: Ground-truth transcriptions of real music from force-aligned MIDI syntheses. In: 4th International Conference on Music Information Retrieval, pp. 135–141 (2003)
Umeda, T., Sekiyama, K., Fukuda, T.: Vision-Based Object Tracking by Multi-Robots. Journal of Robotics and Mechatronics 24(3), 531–539 (2012)
Zhou, X., Zhuang, X., Liu, M., Tang, H., Hasegawa-Johnson, M., Huang, T.: HMM-based Acoustic Event Detection with AdaBoost Feature Selection. In: Stiefelhagen, R., Bowers, R., Fiscus, J.G. (eds.) RT 2007 and CLEAR 2007. LNCS, vol. 4625, pp. 345–353. Springer, Heidelberg (2008)
Zhuang, X., Zhou, X., Hasegawa-Johnson, M.A., Huang, T.S.: Real-world acoustic event detection. Pattern Recognition Letters 31(12), 1543–1551 (2010)
Zieger, C.: An HMM Based System for Acoustic Event Detection. In: Stiefelhagen, R., Bowers, R., Fiscus, J.G. (eds.) RT 2007 and CLEAR 2007. LNCS, vol. 4625, pp. 338–344. Springer, Heidelberg (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
McGibney, D., Morioka, R., Sekiyama, K., Mukai, H., Fukuda, T. (2014). A Multi-Robot Cognitive Sharing System Using Audio and Video Sensors. In: Ani Hsieh, M., Chirikjian, G. (eds) Distributed Autonomous Robotic Systems. Springer Tracts in Advanced Robotics, vol 104. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-55146-8_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-55146-8_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-55145-1
Online ISBN: 978-3-642-55146-8
eBook Packages: EngineeringEngineering (R0)