Abstract
This paper presents a multisensory system for the detection and localisation of fruits that are candidates to be harvested by a robotic manipulator. The devices that have been selected as primary sensors for this purpose are a high resolution colour camera, a multispectral imaging system that consists of a motorised filter wheel, and a Time-Of-Flight 3D camera. A controlled lighting system completes the set-up. The progressive RGB camera and the multispectral imaging system acquire the basic data inputs for the detection of areas of interest that belong to the fruits, whereas the Time-Of-Flight 3D camera provides fast acquisition of accurate distances enabling the localisation of the targets in the coordinate space. Several experimental tests have been carried out in laboratory conditions in order to evaluate the capabilities of the proposed multisensory system.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Sarig, Y.: Robotics of Fruit Harvesting. Journal of Agricultural Engineering Research 54, 265–280 (1990)
Parrish, E., Goksel, A.: Pictorial Pattern Recognition Applied to Fruit Harvesting. Trans. ASAE 20, 8222–8827 (1977)
Slaughter, D., Harrel, R.C.: Color vision in robotic fruit harvesting. Transactions of the ASAE 30(4), 1144–1148 (1987)
Slaughter, D., Harrel, R.C.: Discriminating fruit for robotic harvest using color in natural outdoor scenes. Transactions of the ASAE 32(2), 757–763 (1989)
Whittaker, D., Miles, G.E., Mitchell, O.R., Gaultney, L.D.: Fruit location in a partially occluded image. Transactions of the ASAE 30, 591–597 (1987)
Kassay, L.: Hungarian robotic apple harvester. Paper ASAE Nº 92-7042 St. Joseph, MI 49085, 1–14 (1992)
Buemi, F., Massa, M., Sandini, G.: Agrobot: a robotic system for greenhouse operations. In: 4th Workshop on Robotics in Agriculture, IARP, Toulouse, pp. 172–184 (1985)
Jiménez, A., Ceres, R., Pons, J.: A vision system based on a laser range-finder applied to robotic fruit harvesting. Machine Vision and Applications 11(6), 321–329 (2000)
Jiménez, A., Ceres, R., Pons, J.: A survey of computer vision methods for locating fruits on trees. Transactions of the ASAE 43(6), 1911–1920 (2000)
Ruizendaal, J.: Fruit visibility analysis for different camera positions in sweet peppers. Thesis Farm Technology, MSc Agricultural and Bioresource Engineering, Wageningen University (2011)
Hemming, J., Bac, W., van Tuijl, B.: Fruit detectability analysis for different camera positions in sweet pepper harvesting. In: Proceedings of the International Conference of Agricultural Engineering, CIGR-AgEng 2012, Valencia Spain, July 8-12 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Fernández, R., Salinas, C., Montes, H., Sarria, J., Armada, M. (2014). Validation of a Multisensory System for Fruit Harvesting Robots in Lab Conditions. In: Armada, M., Sanfeliu, A., Ferre, M. (eds) ROBOT2013: First Iberian Robotics Conference. Advances in Intelligent Systems and Computing, vol 252. Springer, Cham. https://doi.org/10.1007/978-3-319-03413-3_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-03413-3_36
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03412-6
Online ISBN: 978-3-319-03413-3
eBook Packages: EngineeringEngineering (R0)