Abstract
In the last decades, smart power wheelchairs have being used by people with motor skill impairment in order to improve their autonomy, independence and quality of life. The most recent power wheelchairs feature many technological devices, such as laser scanners to provide automatic obstacle detection or robotic arms to perform simple operations like pick and place. However, if a motor skill impaired user was able to control a very complex robotic arm, paradoxically he would not need it. For that reason, in this paper we present an autonomous control system based on Computer Vision algorithms which allows the user to interact with buttons or elevator panels via a robotic arm in a simple and easy way. Scale-Invariant Feature Transform (SIFT) algorithm has been used to detect and track buttons. Objects detected by SIFT are mapped in a tridimensional reference system collected with Parallel and Tracking Mapping (PTAM) algorithm. Real word coordinates are obtained using a Maximum-Likelihood estimator, fusing the PTAM coordinates with distance information provided by a proximity sensor. The visual servoing algorithm has been developed in Robotic Operative System (ROS) Environment, in which the previous algorithms are implemented as different nodes. Performances have been analyzed in a test scenario, obtaining good results on the real position of the selected objects.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Madarasz, R.L., Heiny, L.C., Cromp, R.F., Mazur, N.M.: The design of an autonomous vehicle for the disabled. IEEE J. Robot. Autom. 2(3), 117–126 (1986)
Eftring, H., Boschian, K.: Technical results from manus user trials. In: International Conference on Rehabilitation Robotics, ICORR 1999 (1999)
Hillman, M., Gammie, A.: The bath institute of medical engineering assistive robot. In: Proceedings of ICORR, vol. 94, pp. 211–212 (1994)
Elarbi-Boudihir, M., Al-Shalfan, K.A.: Eye-in-hand, eye-to-hand configuration for a WMRA control based on visual servoing. In: 2013 IEEE 11th International Workshop of Electronics, Control, Measurement, Signals and their Application to Mechatronics (ECMSM), pp. 1–6. IEEE (2013)
Palla, A., Frigerio, A., Sarti, L., Fanucci, L.: Embedded implementation of an eye-in-hand visual servoing control for a wheelchair mounted robotic arm. In: IEEE ICTS4eHealth (2016)
Muja, M., Lowe, D.G.: Scalable nearest neighbor algorithms for high dimensional data. IEEE Trans. Pattern Anal. Mach. Intell. 36 (2014)
Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: Proceedings of Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2007), Nara, Japan, November 2007
Engel, J., Sturm, J., Cremers, D.: Scale-aware navigation of a low-cost quadrocopter with a monocular camera. Robot. Autonom. Syst. 62 (2014)
Acknowledgment
This research was supported by Fondazione Cassa di Risparmio di Lucca in the framework of the project “RIMEDIO: Il braccio Robotico Intelligente per Migliorare l’autonomia delle pErsone con DIsabilità mOtoria”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Palla, A., Frigerio, A., Meoni, G., Fanucci, L. (2017). Object Detection and Spatial Coordinates Extraction Using a Monocular Camera for a Wheelchair Mounted Robotic Arm. In: Gaggi, O., Manzoni, P., Palazzi, C., Bujari, A., Marquez-Barja, J. (eds) Smart Objects and Technologies for Social Good. GOODTECHS 2016. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 195. Springer, Cham. https://doi.org/10.1007/978-3-319-61949-1_24
Download citation
DOI: https://doi.org/10.1007/978-3-319-61949-1_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-61948-4
Online ISBN: 978-3-319-61949-1
eBook Packages: Computer ScienceComputer Science (R0)