Automated framework for accurate segmentation of leaf images for plant health assessment
Leaf segmentation is significantly important in assisting ecologists to automatically detect symptoms of disease and other stressors affecting trees. This paper employs state-of-the-art techniques in image processing to introduce an accurate framework for segmenting leaves and diseased leaf spots from images. The proposed framework integrates an appearance model that visually represents the current input image with the color prior information generated from RGB color images that were formerly saved in our database. Our framework consists of four main steps: (1) Enhancing the accuracy of the segmentation at minimum time by making use of contrast changes to automatically identify the region of interest (ROI) of the entire leaf, where the pixel-wise intensity relations are described by an electric field energy model. (2) Modeling the visual appearance of the input image using a linear combination of discrete Gaussians (LCDG) to predict the marginal probability distributions of the grayscale ROI main three classes. (3) Calculating the pixel-wise probabilities of these three classes for the color ROI based on the color prior information of database images that are segmented manually, where the current and prior pixel-wise probabilities are used to find the initial labels. (4) Refining the labels with the generalized Gauss-Markov random field model (GGMRF), which maintains the continuity. The proposed segmentation approach was applied to the leaves of mangrove trees in Abu Dhabi in the United Arab Emirates. Experimental validation showed high accuracy, with a Dice similarity coefficient 90% for distinguishing leaf spot from healthy leaf area.
KeywordsImage processing Segmentation LCDG Plant health Leaf area Mangrove Environmental monitoring Non-destructive
This work is funded by the Office of Research and Sponsored Programs of Abu Dhabi University under grant number 19300068.
- Bauer, S, Korc, F, Förstner, W. (2009). Investigation into the classification of diseases of sugar beet leaves using multispectral images. In E.J. van Henten, D. Goense, C. Lokhorst (Eds.) Precision agriculture (Vol. 9, pp. 229– 238).Google Scholar
- EAD. (2016). Mangrove in UAE: a unique marine ecosystem. Abu Dhabi Government Portal. https://www.abudhabi.ae/portal/public/en/citizens/safety-and-environment/environment/mangroves-in-uae.
- Edwards, C, & Penney, D. (1986). Calculus and analytic geometry, 2nd edn. Upper Saddle: Prentice-Hill.Google Scholar
- Ferreiro-Armán, M, Da Costa, JP, Homayouni, S, Martín-Herrero, J. (2006). Hyperspectral image analysis for precision viticulture. In International conference image analysis and recognition (pp. 730–741): Springer.Google Scholar
- Food and Agriculture Organization (FAO). (2001). State of the world’s forests. Rome: FAO of the United Nations.Google Scholar
- Gerig, G, Jomier, M, Chakos, M. (2001a). Valmet: a new validation tool for assessing and improving 3d object segmentation. In International conference on medical image computing and computer-assisted intervention (pp. 516–523): Springer.Google Scholar
- Gerig, G, Jomier, M, Chakos, M. (2001b). Valmet: a new validation tool for assessing and improving 3D object segmentation, (pp. 516–523). Berlin: Springer.Google Scholar
- Liao, W, Rohr, K, Kang, CK, Cho, ZH, Wörz, S. (2011). A generative mrf approach for automatic 3d segmentation of cerebral vasculature from 7 tesla mra images. In 2011 IEEE international symposium on biomedical imaging: from nano to macro (pp. 2041–2044).Google Scholar
- Lipps, PE. (1998). Gray leaf spot: a global threat to corn productions. APSnet Features, https://doi.org/10.1094/APSnetFeature-1998-0598.
- Lucas, GB, & Campbell, L. (2013). Introduction to plant diseases: identification and management. Berlin: Springer.Google Scholar
- Nagelkerken, I, Blaber, S, Bouillon, S, Green, P, Haywood, M, Kirton, L, Meynecke, JO, Pawlik, J, Penrose, H, Sasekumar, A, Somerfield, P. (2008). The habitat function of mangroves for terrestrial and marine fauna: a review. Aquatic Botany, 89(2), 155–185. mangrove Ecology – Applications in Forestry and Costal Zone Management.CrossRefGoogle Scholar
- Polidoro, BA, Carpenter, KE, Collins, L, Duke, NC, Ellison, AM, Ellison, JC, Farnsworth, EJ, Fernando, ES, Kathiresan, K, Koedam, NE, Livingstone, SR, Miyagi, T, Moore, GE, Nam, VN, Ong, JE, Primavera, JH, Salmo, SG III., Sanciangco, JC, Sukardjo, S, Wang, Y, Yong, JWH. (2010). The loss of species: mangrove extinction risk and geographic areas of global concern. PLoS ONE (4), e10095.Google Scholar
- Powbunthorn, K, Abdullakasim, W, Unartngam, J. (2012). Assessment of the severity of brown leaf spot disease in cassava using image analysis. In Proceedings of international conference of the Thai Society of Agricultural Engineering. Thailand: Chiangmi.Google Scholar
- Prasad, S, Peddoju, SK, Ghosh, D. (2014). Mobile mixed reality based damage level estimation of diseased plant leaf. In Eighth international conference on next generation mobile apps, services and technologies (NGMAST), (Vol. 2014 pp. 72–77): IEEE.Google Scholar
- Viola, P, & Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. In Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition, 2001. CVPR 2001, (Vol. 1 pp. I–I): IEEE.Google Scholar