Skip to main content

Video Analysis Algorithms for Automated Categorization of Fly Behaviors

  • Conference paper
Advances in Visual Computing (ISVC 2012)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7432))

Included in the following conference series:

Abstract

The fruit fly, Drosophila melanogaster, is a well established model organism used to study the mechanisms of both learning and memory in vivo. This paper presents video analysis algorithms that generate data that may be used to categorize fly behaviors. The algorithms aim to replace and improve a labor-intensive, subjective evaluation process with one that is automated, consistent and reproducible; thus allowing for robust, high-throughput analysis of large quantities of video data. The method includes tracking the flies, computing geometric measures, constructing feature vectors, and grouping the specimens using clustering techniques. We also generated a Computed Courtship Index (CCI), a computational equivalent of the existing Courtship Index (CI). The results demonstrate that our automated analysis provides a numerical scoring of fly behavior that is similar to the scoring produced by human observers. They also show that we are able to automatically differentiate between normal and defective flies via analysis of their videotaped movements.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wu, J., Luo, L.: A protocol for mosaic analysis with a repressible cell marker (marcm) in Drosophila. Nat. Protoc. 1, 2583–2589 (2006)

    Article  Google Scholar 

  2. Yu, H., Chen, C., Shi, L., Huang, Y., Lee, T.: Twin-spot marcm to reveal the developmental origin and identity of neurons. Nature Neuroscience 12, 947–953 (2009)

    Article  Google Scholar 

  3. Pitman, J., DasGupta, S., Krashes, M., Leung, B., Perrat, P., Waddell, S.: There are many ways to train a fly. Fly 3, 3 (2009)

    Article  Google Scholar 

  4. Bastock, M., Manning, A.: The courtship of Drosophila melanogaster. Behaviour 8, 85–111 (1955)

    Article  Google Scholar 

  5. Siegel, R., Hall, J.: Conditioned responses in courtship behavior of normal and mutant Drosophila. Proceedings of the National Academy of Sciences 76, 3430 (1979)

    Article  Google Scholar 

  6. Siwicki, K., Riccio, P., Ladewski, L., Marcillac, F., Dartevelle, L., Cross, S., Ferveur, J.: The role of cuticular pheromones in courtship conditioning of Drosophila males. Learning & Memory 12, 636 (2005)

    Article  Google Scholar 

  7. Kamyshev, N., Iliadi, K., Bragina, J.: Drosophila conditioned courtship: Two ways of testing memory. Learning & Memory 6, 1 (1999)

    Google Scholar 

  8. Reza, M.: Automated categorization of Drosophila learning and memory behaviors using video analysis. Master’s thesis. Drexel University, Philadelphia, PA (2011)

    Google Scholar 

  9. Maggio, E., Cavallaro, A.: Video Tracking: Theory and Practice. Wiley (2011)

    Google Scholar 

  10. Isard, M., MacCormick, J.: BraMBLe: A Bayesian multiple-blob tracker. In: Proc. IEEE International Conference on Computer Vision, vol. 2, pp. 34–41 (2001)

    Google Scholar 

  11. Khan, Z., Balch, T., Dellaert, F.: Mcmc-based particle filtering for tracking a variable number of interacting targets. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 1805–1918 (2005)

    Article  Google Scholar 

  12. Branson, K., Rabaud, V., Belongie, S.: Three brown mice: See how they run. In: IEEE International Workshop on Performance Evaluation of Tracking and Surveillance, PETS (2003)

    Google Scholar 

  13. Isard, M., Blake, A.: Condensation – conditional density propagation for visual tracking. International Journal of Computer Vision 29, 5–28 (1998)

    Article  Google Scholar 

  14. Tao, H., Sawhney, H.S., Kumar, R.: A Sampling Algorithm for Tracking Multiple Objects. In: Triggs, B., Zisserman, A., Szeliski, R. (eds.) ICCV-WS 1999. LNCS, vol. 1883, pp. 53–68. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  15. Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 564–577 (2003)

    Article  Google Scholar 

  16. Dankert, H., Wang, L., Hoopfer, E., Anderson, D., Perona, P.: Automated monitoring and analysis of social behavior in Drosophila. Nature Methods 6, 297 (2009)

    Article  Google Scholar 

  17. Branson, K., Robie, A., Bender, J., Perona, P., Dickinson, M.: High-throughput ethomics in large groups of Drosophila. Nature Methods 6, 451 (2009)

    Article  Google Scholar 

  18. Valente, D., Golani, I., Mitra, P.: Analysis of the trajectory of Drosophila melanogaster in a circular open field arena. PloS One 2, e1083 (2007)

    Google Scholar 

  19. Everitt, B., Landau, S., Leese, M., Stahl, D.: Cluster Analysis, 5th edn. John Wiley & Sons, Chichester (2011)

    Book  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Reza, M.A., Marker, J., Mhatre, S., Saunders, A., Marenda, D., Breen, D. (2012). Video Analysis Algorithms for Automated Categorization of Fly Behaviors. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2012. Lecture Notes in Computer Science, vol 7432. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33191-6_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33191-6_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33190-9

  • Online ISBN: 978-3-642-33191-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics