Environment Systems and Decisions

, Volume 34, Issue 3, pp 406–416 | Cite as

A multi-instance learning approach to filtering images for presentation to analysts



This paper proposes an image filtering and retrieval system driven by the multi-instance learning (MIL) algorithm. This system is aimed at improving the mission effectiveness of human analysts in searching through imagery for environmental, defense, or other purposes. Thus, the system is tuned and the experimental results are measured in terms of the true positive rate in predicted labels. While MIL has been used in image retrieval before, this paper examines how different tasks and feature spaces impact the performance of the algorithm. Images are translated into the single blob with neighbors (SBN) feature space, a novel feature space called color, texture, and shape (CTS), and a combined SBN and CTS feature space, for processing by the MIL algorithm. The paper introduces a feature space selection step in the classification process and shows that the true positive rate can be increased through the addition of this step.


Multi-instance learning Machine learning Decision support Image processing Feature selection Information retrieval 



The authors would like to thank Laurie Gibson, Chief Scientist, SAIC Inc. for her gracious help with the human subject experiment and her advice regarding this paper. The first author gratefully acknowledges support from an SAIC Graduate Fellowship at the University of Virginia. This material is based upon work supported by the National Science Foundation under Grant No. EEC-0827153.


  1. Anderson K, Gaston KJ (2013) Lightweight unmanned aerial vehicles will revolutionize spatial ecology. Front Ecol Environ 11(3):138–146CrossRefGoogle Scholar
  2. Andrews S, Hofmann T, Tsochantaridis I (2002) Multiple instance learning with generalized support vector machines. In: AAAI/IAAI, pp 943–944Google Scholar
  3. Chevaleyre Y, Zucker JD (2000) Noise-tolerant rule induction from multi-instance data. In: ICML 2000, workshop on attribute-value and relational learningGoogle Scholar
  4. Dietterich TG, Lathrop RH, Lozano-Pérez T (1997) Solving the multiple instance problem with axis-parallel rectangles. Artif Intell 89(1–2):31–71. doi: 10.1016/S0004-3702(96)00034-3 CrossRefGoogle Scholar
  5. Kim K, Owechko Y, Flores A, Korchev D (2011) Multisensor ISR in geo-registered contextual visual dataspace (cvd). In: Society of Photo-Optical Instrumentation Engineers (SPIE) conference series, vol 8049, p 20Google Scholar
  6. Maron O, Lozano-Prez T (1998) A framework for multiple-instance learning. In: Advances in neural information processing systems. MIT Press, pp 570–576Google Scholar
  7. Maron O, Ratan AL (1998) Multiple-instance learning for natural scene classification. In: In the fifteenth international conference on machine learning. Morgan Kaufmann, pp 341–349Google Scholar
  8. Nisbet R, Elder J IV, Miner G (2009) Handbook of statistical analysis and data mining applications. Academic Press, LondonGoogle Scholar
  9. Peters J (2014) Texture and texture set patterns. In: Topology of digital images, intelligent systems reference library, vol 63. Springer, Berlin, pp 301–315Google Scholar
  10. Qiao Q, Beling PA (2009) Localized content based image retrieval with self-taught multiple instance learning. In: ICDM Workshops, pp 170–175Google Scholar
  11. Tong S, Chang E (2001) Support vector machine active learning for image retrieval. In: Proceedings of the ninth ACM international conference on multimedia, ACM, New York, NY, USA, MULTIMEDIA ’01, pp 107–118. doi: 10.1145/500141.500159
  12. Touryan J, Gibson L, Horne J, Weber P (2010) Real-time classification of neural signals corresponding to the detection of targets in video imagery. CRC Press, pp 190–199. doi: 10.1201/EBK1439835012-c19
  13. Touryan J, Gibson L, Horne JH, Weber P (2011) Real-time measurement of face recognition in rapid serial visual presentation. Front Psychol 2Google Scholar
  14. Wang J (2000) Solving the multiple-instance problem: a lazy learning approach. In: Proceedings 17th international conference on machine learning. Morgan Kaufmann, pp 1119–1125Google Scholar
  15. Yang C, Lozano-Perez T (2000) Image database retrieval with multiple-instance learning techniques. In: Proceedings 16th international conference on data engineering, 2000, pp 233–243. doi: 10.1109/ICDE.2000.839416
  16. Zhou Z, Zhang M (2007) Multi-instance multilabel learning with application to scene classification. Adv Neural Inf Process Syst 19Google Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  1. 1.Agilex Technologies, Inc.ChantillyUSA
  2. 2.Department of Systems and Information EngineeringUniversity of VirginiaCharlottesvilleUSA

Personalised recommendations