Skip to main content
SpringerLink
Log in

LifeCLEF 2017 Lab Overview: Multimedia Species Identification Challenges

  • Conference paper
  • First Online:
Experimental IR Meets Multilinguality, Multimodality, and Interaction (CLEF 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10456))

Abstract

Automated multimedia identification tools are an emerging solution towards building accurate knowledge of the identity, the geographic distribution and the evolution of living plants and animals. Large and structured communities of nature observers as well as big monitoring equipment have actually started to produce outstanding collections of multimedia records. Unfortunately, the performance of the state-of-the-art analysis techniques on such data is still not well understood and far from reaching real world requirements. The LifeCLEF lab proposes to evaluate these challenges around 3 tasks related to multimedia information retrieval and fine-grained classification problems in 3 domains. Each task is based on large volumes of real-world data and the measured challenges are defined in collaboration with biologists and environmental stakeholders to reflect realistic usage scenarios. For each task, we report the methodology, the data sets as well as the results and the main outcomes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://ebird.org/content/ebird/.

  2. 2.

    http://www.inaturalist.org/.

  3. 3.

    http://www.xeno-canto.org/.

  4. 4.

    http://www.tela-botanica.org/.

  5. 5.

    http://www.gbif.org/.

  6. 6.

    https://stateoftheworldsplants.com/.

  7. 7.

    http://www.lifeclef.org/.

  8. 8.

    http://www.imageclef.org/.

  9. 9.

    http://eol.org/.

  10. 10.

    https://itunes.apple.com/fr/app/plantnet/id600547573?mt=8.

  11. 11.

    https://play.google.com/store/apps/details?id=org.plantnet.

  12. 12.

    http://www.xeno-canto.org/contributors.

  13. 13.

    We precise that there was probably a bug in the runfile MLRG_Run2 that performed abnormally low with regard to the used technique.

References

  1. Affouard, A., Goeau, H., Bonnet, P., Lombardo, J.C., Joly, A.: Pl@ntnet app. in the era of deep learning. In: 5th International Conference on Learning Representations (ICLR 2017), 24–26 April 2017, Toulon, France (2017)

    Google Scholar 

  2. Atito, S., Yanikoglu, B., Aptoula, E.: Plant identification with large number of classes: Sabanciu-gebzetu system in plantclef 2017. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  3. Baillie, J., Hilton-Taylor, C., Stuart, S.N.: 2004 IUCN red list of threatened species: a global species assessment. Iucn (2004)

    Google Scholar 

  4. Briggs, F., Lakshminarayanan, B., Neal, L., Fern, X.Z., Raich, R., Hadley, S.J., Hadley, A.S., Betts, M.G.: Acoustic classification of multiple simultaneous bird species: A multi-instance multi-label approach. J. Acoust. Soc. Am. 131, 4640 (2012)

    Article  Google Scholar 

  5. Cai, J., Ee, D., Pham, B., Roe, P., Zhang, J.: Sensor network for the monitoring of ecosystem: Bird species recognition. In: 3rd International Conference on Intelligent Sensors, Sensor Networks and Information, ISSNIP 2007 (2007)

    Google Scholar 

  6. Choi, S.: Fish identification in underwater video with deep convolutional neural network: snumedinfo at lifeclef fish task 2015. In: Working Notes of CLEF 2015 (Cross Language Evaluation Forum) (2015)

    Google Scholar 

  7. Papp, D., Mogyorósi, F., Szücs, G.: Image matching for individual recognition with SIFT, RANSAC and MCL. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  8. Sprengel, E., Martin Jaggi, Y.K., Hofmann, T.: Audio based bird species identification using deep learning techniques. In: Working Notes of CLEF 2016 (Cross Language Evaluation Forum) (2016)

    Google Scholar 

  9. Fazekas, B., Schindler, A., Lidy, T.: A multi-modal deep neural network approach to bird-song identication. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  10. Fritzler, A., Koitka, S., Friedrich, C.M.: Recognizing bird species in audio files using transfer learning. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  11. Gaston, K.J., O’Neill, M.A.: Automated species identification: why not? Philos. Trans. R. Soc. Lond. B Biol. Sci. 359(1444), 655–667 (2004)

    Article  Google Scholar 

  12. Goëau, H., Bonnet, P., Joly, A.: Plant identification based on noisy web data: the amazing performance of deep learning (lifeclef 2017). In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  13. Goëau, H., Bonnet, P., Joly, A., Bakic, V., Barthélémy, D., Boujemaa, N., Molino, J.F.: The imageclef 2013 plant identification task. In: CLEF 2013, Valencia (2013)

    Google Scholar 

  14. Goëau, H., Bonnet, P., Joly, A., Boujemaa, N., Barthélémy, D., Molino, J.F., Birnbaum, P., Mouysset, E., Picard, M.: The imageclef 2011 plant images classification task. In: CLEF 2011 (2011)

    Google Scholar 

  15. Goëau, H., Bonnet, P., Joly, A., Yahiaoui, I., Barthélémy, D., Boujemaa, N., Molino, J.F.: Imageclef 2012 plant images identification task. In: CLEF 2012, Rome (2012)

    Google Scholar 

  16. Goëau, H., Glotin, H., Planqué, R., Vellinga, W.P., Joly, A.: Lifeclef bird identification task 2016. In: CLEF 2016 (2016)

    Google Scholar 

  17. Goëau, H., Glotin, H., Planqué, R., Vellinga, W.P., Joly, A.: Lifeclef bird identification task 2017. In: CLEF 2017 (2017)

    Google Scholar 

  18. Hang, S.T., Aono, M.: Residual network with delayed max pooling for very large scale plant identification. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  19. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  20. Hinton, G., Vinyals, O., Dean, J.: Distilling the knowledge in a neural network. arXiv preprint arxiv:1503.02531 (2015)

  21. Ioffe, S., Szegedy, C.: Batch normalization: Accelerating deep network training by reducing internal covariate shift. CoRR abs/1502.03167 (2015). http://arxiv.org/abs/1502.03167

  22. Jaisakthi, S., Mirunalini, P., Jadhav, R.: Automatic whale matching system using feature descriptor. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  23. Joly, A., Bonnet, P., Goëau, H., Barbe, J., Selmi, S., Champ, J., Dufour-Kowalski, S., Affouard, A., Carré, J., Molino, J.F., et al.: A look inside the pl@ ntnet experience. Multimedia Syst. 22(6), 751–766 (2016)

    Article  Google Scholar 

  24. Joly, A., Goëau, H., Bonnet, P., Bakić, V., Barbe, J., Selmi, S., Yahiaoui, I., Carré, J., Mouysset, E., Molino, J.F., et al.: Interactive plant identification based on social image data. Ecol. Inform. 23, 22–34 (2014)

    Article  Google Scholar 

  25. Joly, A., Goëau, H., Bonnet, P., Bakic, V., Molino, J.F., Barthélémy, D., Boujemaa, N.: The imageclef plant identification task 2013. In: International Workshop on Multimedia Analysis for Ecological Data (2013)

    Google Scholar 

  26. Joly, A., Goëau, H., Glotin, H., Spampinato, C., Bonnet, P., Vellinga, W.P., Champ, J., Planqué, R., Palazzo, S., Müller, H.: Lifeclef 2016: multimedia life species identification challenges. In: International Conference of the Cross-Language Evaluation Forum for European Languages 2016 (2016)

    Google Scholar 

  27. Joly, A., Lombardo, J.C., Champ, J., Saloma, A.: Unsupervised individual whales identification: spot the difference in the ocean. In: Working Notes of CLEF 2016 (Cross Language Evaluation Forum) (2016)

    Google Scholar 

  28. Kahl, S., Wilhelm-Stein, T., Hussein, H., Klinck, H., Kowerko, D., Ritter, M., Eibl, M.: Large-scale bird sound classification using convolutional neural networks. In: CLEF 2017 (2017)

    Google Scholar 

  29. Krause, J., Sapp, B., Howard, A., Zhou, H., Toshev, A., Duerig, T., Philbin, J., Fei-Fei, L.: The unreasonable effectiveness of noisy data for fine-grained recognition. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9907, pp. 301–320. Springer, Cham (2016). doi:10.1007/978-3-319-46487-9_19

    Chapter  Google Scholar 

  30. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)

    Google Scholar 

  31. Kumar, N., Belhumeur, P.N., Biswas, A., Jacobs, D.W., Kress, W.J., Lopez, I.C., Soares, J.V.B.: Leafsnap: a computer vision system for automatic plant species identification. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, pp. 502–516. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33709-3_36

    Chapter  Google Scholar 

  32. Lasseck, M.: Image-based plant species identification with deep convolutional neural networks. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  33. Lee, D.J., Schoenberger, R.B., Shiozawa, D., Xu, X., Zhan, P.: Contour matching for a fish recognition and migration-monitoring system. In: Optics East, pp. 37–48. International Society for Optics and Photonics (2004)

    Google Scholar 

  34. Lee, S.H., Chang, Y.L., Chan, C.S.: Lifeclef 2017 plant identification challenge: classifying plants using generic-organ correlation features. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  35. Ludwig, A.R., Piorek, H., Kelch, A.H., Rex, D., Koitka, S., Friedrich, C.M.: Improving model performance for plant image classification with filtered noisy images. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  36. Nilsback, M.E., Zisserman, A.: Automated flower classification over a large number of classes. In: Proceedings of the Indian Conference on Computer Vision, Graphics and Image Processing, December 2008

    Google Scholar 

  37. Sevilla, A., Glotin, H.: Audio bird classification with inception v4 joint to an attention mechanism. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  38. Silvertown, J., Harvey, M., Greenwood, R., Dodd, M., Rosewell, J., Rebelo, T., Ansine, J., McConway, K.: Crowdsourcing the identification of organisms: a case-study of ispot. ZooKeys 480, 125 (2015)

    Google Scholar 

  39. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556 (2014)

    Google Scholar 

  40. Śulc, M., Matas, J.: Learning with noisy and trusted labels for fine-grained plant recognition. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  41. Sullivan, B.L., Aycrigg, J.L., Barry, J.H., Bonney, R.E., Bruns, N., Cooper, C.B., Damoulas, T., Dhondt, A.A., Dietterich, T., Farnsworth, A., et al.: The ebird enterprise: an integrated approach to development and application of citizen science. Biol. Conserv. 169, 31–40 (2014)

    Article  Google Scholar 

  42. Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.: Inception-v4, inception-resnet and the impact of residual connections on learning. arXiv preprint arXiv:1602.07261 (2016)

  43. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)

    Google Scholar 

  44. Toma, A., Stefan, L.D., Ionescu, B.: Upb hes so @ plantclef 2017: automatic plant image identification using transfer learning via convolutional neural networks. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

  45. Towsey, M., Planitz, B., Nantes, A., Wimmer, J., Roe, P.: A toolbox for animal call recognition. Bioacoustics 21(2), 107–125 (2012)

    Article  Google Scholar 

  46. Trifa, V.M., Kirschel, A.N., Taylor, C.E., Vallejo, E.E.: Automated species recognition of antbirds in a mexican rainforest using hidden markov models. J. Acoust. Soc. Am. 123, 2424 (2008)

    Article  Google Scholar 

  47. Wilson, E.O.: The encyclopedia of life. Trends Ecol. Evol. 18(2), 77–80 (2003)

    Article  Google Scholar 

  48. Zhuang, P., Xing, L., Liu, Y., Guo, S., Qiao, Y.: Marine animal detection and recognition with advanced deep learning models. In: Working Notes of CLEF 2017 (Cross Language Evaluation Forum) (2017)

    Google Scholar 

Download references

Acknowledgements

The organization of the PlantCLEF task is supported by the French project Floris’Tic (Tela Botanica, INRIA, CIRAD, INRA, IRD) funded in the context of the national investment program PIA. The organization of the BirdCLEF task is supported by the Xeno-Canto foundation for nature sounds as well as the French CNRS project SABIOD.ORG and EADM MADICS, and Floris’Tic. The annotations of some soundscape were prepared with regreted wonderful Lucio Pando at Explorama Lodges, with the support of Pam Bucur, Marie Trone and H. Glotin. The organization of the SeaCLEF task is supported by the Ceta-mada NGO and the French project Floris’Tic.

Author information

Authors and Affiliations

  1. Inria, LIRMM, Montpellier, France

    Alexis Joly & Jean-Christophe Lombardo

  2. CIRAD, UMR AMAP, Montpellier, France

    Hervé Goëau & Pierre Bonnet

  3. AMU, CNRS LSIS, ENSAM, University of Toulon, IUF, Toulon, France

    Hervé Glotin

  4. University of Catania, Catania, Italy

    Concetto Spampinato & Simone Palazzo

  5. Xeno-canto Foundation, Meijendel, The Netherlands

    Willem-Pier Vellinga & Robert Planqué

  6. HES-SO, Sierre, Switzerland

    Henning Müller

Authors
  1. Alexis Joly
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hervé Goëau
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hervé Glotin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Concetto Spampinato
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Pierre Bonnet
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Willem-Pier Vellinga
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jean-Christophe Lombardo
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Robert Planqué
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Simone Palazzo
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Henning Müller
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alexis Joly .

Editor information

Editors and Affiliations

  1. Dublin City University, Dublin, Ireland

    Gareth J.F. Jones

  2. Trinity College Dublin, Dublin, Ireland

    Séamus Lawless

  3. National University of Distance Education, Madrid, Spain

    Julio Gonzalo

  4. Dublin City University, Dublin, Ireland

    Liadh Kelly

  5. Université Grenoble Alpes, Grenoble, France

    Lorraine Goeuriot

  6. University of Hildesheim, Hildesheim, Germany

    Thomas Mandl

  7. University of Padua, Padua, Italy

    Linda Cappellato

  8. University of Padua, Padua, Italy

    Nicola Ferro

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Joly, A. et al. (2017). LifeCLEF 2017 Lab Overview: Multimedia Species Identification Challenges. In: Jones, G., et al. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2017. Lecture Notes in Computer Science(), vol 10456. Springer, Cham. https://doi.org/10.1007/978-3-319-65813-1_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65813-1_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65812-4

  • Online ISBN: 978-3-319-65813-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation