Abstract
We describe a working computer vision system that aids in the identification of plant species. A user photographs an isolated leaf on a blank background, and the system extracts the leaf shape and matches it to the shape of leaves of known species. In a few seconds, the system displays the top matching species, along with textual descriptions and additional images. This system is currently in use by botanists at the Smithsonian Institution National Museum of Natural History. The primary contributions of this paper are: a description of a working computer vision system and its user interface for an important new application area; the introduction of three new datasets containing thousands of single leaf images, each labeled by species and verified by botanists at the US National Herbarium; recognition results for two of the three leaf datasets; and descriptions throughout of practical lessons learned in constructing this system.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Download to read the full chapter text
Chapter PDF
References
Abbasi, S., Mokhtarian, F., Kittler, J.: Reliable classification of chrysanthemum leaves through curvature scale space. In: ter Haar Romeny, B.M., Florack, L.M.J., Viergever, M.A. (eds.) Scale-Space 1997. LNCS, vol. 1252, pp. 284–295. Springer, Heidelberg (1997)
Agarwal, G., Belhumeur, P., Feiner, S., Jacobs, D., Kress, W.J., Ramamoorthi, R., Bourg, N., Dixit, N., Ling, H., Mahajan, D., Russell, R., Shirdhonkar, S., Sunkavalli, K., White, S.: First steps towards an electronic field guide for plants. Taxon 55, 597–610 (2006)
Bederson, B.: PhotoMesa: A zoomable image browser using quantum treemaps and bubblemaps. In: Proc. ACM UIST 2001, pp. 71–80 (2001)
Bederson, B., Grosjean, J., Meyer, J.: Toolkit design for interactive structured graphics. IEEE Trans. on Soft. Eng. 30(8), 535–546 (2004)
Belongie, S., Malik, J., Puzicha, J.: Shape Matching and Object Recognition Using Shape Context. IEEE Trans. on Patt. Anal. and Mach. Intell. 24(4), 509–522 (2002)
Edwards, M., Morse, D.R.: The potential for computer-aided identification in biodiversity research. Trends in Ecology and Evolution 10, 153–158 (1995)
Fiala, M.: ARTag, a fiducial marker system using digital techniques. In: Proc. CVPR 2005, pp. 590–596 (2005)
Felzenszwalb, P., Schwartz, J.: Hierarchical matching of deformable shapes. In: Proc. CVPR 2007, pp. 1–8 (2007)
Forsyth, D., Ponce, J.: Computer vision: A modern approach. Prentice Hall, Upper Saddle River (2003)
Galun, M., Sharon, E., Basri, R., Brandt, A.: Texture segmentation by multiscale aggregation of filter responses and shape elements. In: Proc. CVPR, pp. 716–723 (2003)
Heidorn, P.B.: A tool for multipurpose use of online flora and fauna: The Biological Information Browsing Environment (BIBE). First Monday 6(2) (2001), http://firstmonday.org/issues/issue6_2/heidorn/index.html
Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K., Tachibana, K.: Virtual object manipulation of a table-top AR environment. In: Proc. IEEE and ACM ISAR, pp. 111–119 (2000)
Ling, H., Jacobs, D.: Shape Classification Using the Inner-Distance. IEEE Trans. on Patt. Anal. and Mach. Intell. 29(2), 286–299 (2007)
Mokhtarian, F., Abbasi, S.: Matching shapes with self-intersections: Application to leaf classification. Proc. IEEE Trans. on Image 13(5), 653–661 (2004)
Nilsback, M., Zisserman, A.: A visual vocabulary for flower classification. In: Proc. CVPR, pp. 1447–1454 (2006)
Pankhurst, R.J.: Practical taxonomic computing. Cambridge University Press, Cambridge (1991)
Ruiz, E.: An algorithm for finding nearest neighbours in (approximately) constant average time. Patt. Rec. Lett. 4(3), 145–157 (1986)
Saitoh, T., Kaneko, T.: Automatic recognition of wild flowers. Proc. ICPR 2, 2507–2510 (2000)
Shi, J., Malik, J.: Normalized Cuts and Image Segmentation. IEEE Trans. on Patt. Anal. and Mach. Intell. 22(8), 888–905 (2000)
Söderkvist, O.: Computer vision classification of leaves from Swedish trees. Master Thesis, Linköping Univ. (2001)
Stevenson, R.D., Haber, W.A., Morris, R.A.: Electronic field guides and user communities in the eco-informatics revolution. Conservation Ecology 7(3) (2003), http://www.consecol.org/vol7/iss1/art3
Vidal, E.: New formulation and improvements of the nearest-neighbour approximating and eliminating search algorithm (AESA). Patt. Rec. Lett. 15(1), 1–7 (1994)
Wang, Z., Chi, W., Feng, D.: Shape based leaf image retrieval. IEE Proc. Vision, Image and Signal Processing 150(1), 34–43 (2003)
White, S., Feiner, S., Kopylec, J.: Virtual vouchers: Prototyping a mobile augmented reality user interface for botanical species identification. In: Proc. IEEE Symp. on 3DUI, pp. 119–126 (2006)
White, S., Marino, D., Feiner, S.: Designing a mobile user interface for automated species identification. In: Proc. CHI 2007, pp. 291–294 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Belhumeur, P.N. et al. (2008). Searching the World’s Herbaria: A System for Visual Identification of Plant Species. In: Forsyth, D., Torr, P., Zisserman, A. (eds) Computer Vision – ECCV 2008. ECCV 2008. Lecture Notes in Computer Science, vol 5305. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88693-8_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-88693-8_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88692-1
Online ISBN: 978-3-540-88693-8
eBook Packages: Computer ScienceComputer Science (R0)