Identifying immature and mature pomelo fruits in trees by elliptical model fitting in the Cr–Cb color space
In precision agriculture, identification of fruit in trees is important. Furthermore, it is also essential for estimating the yield, targeting the exact location for a harvesting robot and selectively harvesting the fruit. An elliptical boundary model-based machine vision algorithm was developed to identify immature and mature pomelo fruit in trees. In the proposed solution, the images were converted from RGB space to Y′CbCr space. Then, ordinary least-squares (OLS) was introduced in fitting implicit second order polynomials of elliptical boundary models in the Cr–Cb color space for segmenting immature green fruits, mature green, green partial white, green partial yellow and green partial red fruits. Those elliptical boundary models along with area opening mathematical morphology and diameter thresholding were applied in the identification procedure. The algorithm was tested on a set of 200 validation images acquired under natural illumination conditions. The results of the validation test showed that the total correct identification rate was 93.5%. The total false positive, missed rate, repeated rate and merged rate were equal to 8.2, 6.5, 10.2 and 10.6%, respectively. The proposed method performed better in detecting mature fruit, the color of which is different from green, than in detecting immature green fruit. On average, the segmenting time for 640 × 480 and 1280 × 960 images were 0.134 and 0.200 s, respectively and the total identification time for 640 × 480 and 1280 × 960 images were 0.240 and 0.362 s, respectively.
KeywordsComputer vision Pomelo Fruit detection Elliptical boundary model
This research is co-supported by Guangdong Science and Technology Plan Project with Research Grant 2017A010102024, National Key R & D Plan of China with Research Grant 2017YFD0700100 and National Science Project of China with Research Grant 31571568.
- Annamalai, P., Lee, W. S., & Burks, T. F. (2004). Color vision system for estimating citrus yield in real-time. Paper No. 043054. St Joseph, MI, USA: ASAE.Google Scholar
- Ehsani, R., Toudeshki, A., & Wan, P. (2016). New sensor technology for yield estimation and disease detection. In Tomato Proceedings, 15–16, Immokale, FL, USA: UF/IFAS.Google Scholar
- Kane, K. E., & Lee, W. S. (2007). Multispectral imaging for in-field green citrus identification. Paper No. 073025. St. Joseph, MI, USA: ASABE.Google Scholar
- Lee, J. Y., & Yoo, S. I. (2002). An elliptical boundary model for skin color detection. In Proceedings of the International Conference on Imaging Science, Systems and Technology. Las Vegas, Nevada, USA: CSREA Press (pp. 579–584).Google Scholar
- MacArthur, D. K., Schueller, J. K., Lee, W. S., Crane, C. D., MacArthur, E. Z., & Parsons, L. R. (2006). Remotely-piloted helicopter citrus yield map estimation. Paper No. 063096. St. Joseph, MI, USA: ASABE.Google Scholar
- Matheron, G. (1975). Random sets and integral geometry. New York, NY, USA: Wiley.Google Scholar