Abstract
Traditional approaches to Multiple-Instance Learning (MIL) operate under the assumption that the instances of a bag are generated independently, and therefore typically learn an instance-level classifier which does not take into account possible dependencies between instances. This assumption is particularly inappropriate in visual data, where spatial dependencies are the norm. We introduce here techniques for incorporating MIL constraints into Conditional Random Field models, thus providing a set of tools for constructing structured bag models, in which spatial (or other) dependencies are represented. Further, we show how Deterministic Annealing, which has proved a successful method for training non-structured MIL models, can also form the basis of training models with structured bags. Results are given on various segmentation tasks.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: From Contours to Regions: An Empirical Evaluation. In: CVPR (2009)
Batra, D., Kowdle, A., Parikh, D., Luo, J., Chen, T.: iCoseg: Interactive Cosegmentation with Intelligent Scribble Guidance. In: CVPR (2010)
Babenko, B., Yang, M.H., Belongie, S.: Visual tracking with online multiple instance learning. In: CVPR (2009)
Bertsekas, D.: Nonlinear Programming. Athena Scientific (1999)
Besag, J.: Statistical analysis of non-lattice data. The Statistician 24, 179–195 (1975)
Gehler, P.V., Chapelle, O.: Deterministic Annealing for Multiple-Instance Learning. In: AISTATS (2007)
Gould, S., Gao, T., Koller, D.: Region-based Segmentation and Object Detection. In: NIPS (2009)
Kohli, P., Ladicky, L., Torr, P.H.S.: Robust Higher Order Potentials for Enforcing Label Consistency. In: IJCV (2009)
Komodakis, N., Paragios, N., Tziritas, G.: MRF Optimization via Dual Decomposition: Message- passing Revisited. In: ICCV (2005)
Ladicky, L., Russell, C., Kohli, P., Torr, P.H.S.: Associative Hierarchical CRFs for Object Class Image Segmentation. In: ICCV (2009)
Ladicky, L., Russell, C., Kohli, P., Torr, P.H.S.: Graph Cut Based Inference with Co-occurrence Statistics. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6315, pp. 239–253. Springer, Heidelberg (2010)
Leistner, C., Saffari, A., Bischof, H.: MIForests: Multiple-Instance Learning with Randomized Trees. In: ECCV (2009)
Leistner, C., Saffari, A., Santner, J., Bischof, H.: Semi-supervised Random Forests. In: ICCV (2009)
Rose, K.: Deterministic annealing, constrained clustering, and optimization. In: IJCNN (1998)
Rother, C., Kolmogorov, V., Minka, T., Blake, A.: Cosegmentation of Image Pairs by Histogram Matching - Incorporating a Global Constraint into MRFs. In: CVPR (2006)
Saffari, A., Leistner, C., Godec, M., Santner, J., Bischof, H.: On-line Random Forests. In: OLCV (2009)
Shotton, J., Winn, J., Rother, C., Criminisi, A.: TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-class Object Recognition and Segmentation. In: ECCV (2006)
Vezhnevets, A., Buhmann, J.: Towards weakly supervised semantic segmentation by means of multiple instance and multitask learning. In: CVPR (2010)
Vicente, S., Kolmogorov, V., Rother, C.: Joint optimization of segmentation and appearance models. In: ICCV (2009)
Vicente, S., Kolmogorov, V., Rother, C.: Cosegmentation revisited: Models and optimization. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6312, pp. 465–479. Springer, Heidelberg (2010)
Viola, P., Platt, J.C., Zang, C.: Multiple instance boosting for object detection. In: NIPS (2005)
Warrell, J., Prince, S., Torr, P.H.S.: StyP-Boost: A Bilinear Boosting Algorithm for Learning Style-Parameterized Classifiers. In: BMVC (2010)
Woodford, O.J., Rother, C., Kolmogorov, V.: A Global Perspective on MAP inference for Low-Level Vision. In: ICCV (2009)
Zha, Z., Hua, X., Mei, T., Wang, J., Qi, G., Wang, Z.: Joint multi-label multi-instance learning for image classification. In: CVPR (2008)
Zhou, Z., Zang, M.: Multiple-Instance Multi-Label Learning with application to Scene Classification. In: NIPS (2006)
Zhou, Z., Sun, Y., Li, Y.: Multiple-Instance Learning by Treating Instances as Non-I.I.D. Samples. In: ICML (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Warrell, J., Torr, P.H.S. (2011). Multiple-Instance Learning with Structured Bag Models. In: Boykov, Y., Kahl, F., Lempitsky, V., Schmidt, F.R. (eds) Energy Minimization Methods in Computer Vision and Pattern Recognition. EMMCVPR 2011. Lecture Notes in Computer Science, vol 6819. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23094-3_27
Download citation
DOI: https://doi.org/10.1007/978-3-642-23094-3_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23093-6
Online ISBN: 978-3-642-23094-3
eBook Packages: Computer ScienceComputer Science (R0)