Abstract
A reliable vision system for running robotic errand service in an unstructured indoor environment such as homes is difficult to construct. Many visual challenges, such as perspective, clutter, illumination, and occlusion, need to be handled appropriately. While most of previous researches addressed these problems from the contexts of either object recognition or object searching, our proposed approach relies on a solution that combines these two as one. We are proposing a “Cognitive Recognition” System. In the proposed cognitive recognition system, information gathered from scene recognition helps deciding the next optimal perspective, and environmental parameters measurements determine the uncertainty in recognition measurements and thus the proper probability map update used in object search. We show particularly in this paper how this approach provides a practical solution to cluttered and occluded environments. And we demonstrate the results with our HomeMate Service Robot.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Kemp, C.C., Edsinger, A., Torres-Jara, E., “Challenges for robot manipulation in human environments [Grand Challenges of Robotics],” March 2007 Robotics & Automation Magazine, IEEE (Volume:14, Issue: 1).
M. Bertsche, T. Fromm, and W. Ertel, “BOR3D: A Use-Case-Oriented Software Framework for 3-D Object Recognition,” 2012 IEEE Conference on Technologies for Practical Robot Applications, Woburn.
A. Collet, M. Martinez, and S. S. Srinivasa, “The MOPED framework: Object Recognition and Pose Estimation for Manipulation,” Sep. 2011 the International Journal of Robotics Research, vol. 30, no. 10, pp. 1284–1306.
F. A. Pavel, Z. Wang, and D. D. Feng, “Reliable Object Recognition using SIFT Features,” MMSP’09, October 5–7, 2009, Rio de Janeiro, Brazil.
S. Lee, S. Lee, J. Lee, D. Moon, E. Kim, and J. Seo, “Robust Recognition and Pose Estimation of 3D Objects Based on Evidence Fusion in a Sequence of Images,” 10–14 April 2007 IEEE International Conference on Robotics and Automation Roma, Italy.
S. Lee, E. Kim, and Y. Park, “3D Object Recognition using Multiple Features for Robotic Manipulation,” May 2006 IEEE International Conference on Robotics and Automation, Orlando, Florida.
S. Lee, Z. Lu, and H. Kim, “Probabilistic 3D Object Recognition with Both Positive and Negative Evidences,” 2011 IEEE International Conference on Computer Vision.
H. Kim, J. Lee and S. Lee, “Environment Adaptive 3D Object Recognition and Pose Estimation by Cognitive Perception Engine,” 2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA).
Y. Ye, J.K. Tsotsos, “Sensor planning for 3d object search, Comput. Vis. Image Understand,” 73 (2) (1999) 145–168.
T.D. Garvey, “Perceptual strategies for purposive vision, Technical report, SRI International,” 117, 1976.
L. Wixson, D. Ballard, “Using intermediate object to improve efficiency of visual search,” Int. J. Comput. Vis. 18 (3) (1994) 209–230.
K. Sj öö, D. G’alvez-L’opez, C. Paul, P. Jensfelt, and D. Kragic, “Object search and localization for an indoor mobile robot,” J. Computing and IT, vol. 17, no. 1, pp. 67–80, 2009.
A. Aydemir, K. Sj öö, J. Folkesson, A. Pronobis, and P. Jensfelt, “Search in the real world: Active visual object search based on spatial relations,” in ICRA, 2011.
T. Kollar and N. Roy, “Utilizing object-object and object-scene context when planning to find things,” in ICRA, 2009.
HomeMate errand service demo: http://www.youtube.com/watch?v=4ENFcHP1GaI
Ahmed M.Naguib, Sukhan Lee, “Adaptive Bayesian Recognition with Multiple Evidences,” 2014 The 4th International Conference on Multimedia Computing and Systems (ICMCS) (To be published by April 2014).
Xi Chen, Sukhan Lee, “Visual search of an object in cluttered environments for robotic errand service,” 2013 IEEE International Conference on Systems, Man, and Cybernetics (SMC).
Acknowledgments
This work is supported in part by MEGA Science R&D Project, funded by Ministry of Science ICT and Future Planning (NRF-2013MIA3A3A02042335), in part by Technology Innovation Program (10048320) funded by Ministry of Trade, Industry and Energy, and in part by Basic Science Research Program through NRF (NRF-2010-0020210) funded by Ministry of Education.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Naguib, A.M., Chen, X., Lee, S. (2016). Cognitive Recognition Under Occlusion for Visually Guided Robotic Errand Service. In: Menegatti, E., Michael, N., Berns, K., Yamaguchi, H. (eds) Intelligent Autonomous Systems 13. Advances in Intelligent Systems and Computing, vol 302. Springer, Cham. https://doi.org/10.1007/978-3-319-08338-4_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-08338-4_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08337-7
Online ISBN: 978-3-319-08338-4
eBook Packages: EngineeringEngineering (R0)