Abstract
This paper further develops the novel notion of deconstructive learning and proposes a practical model for deconstructing a broad class of binary classifiers commonly used in vision applications. Specifically, the problem studied in this paper is: Given an image-based binary classifier \({\mathbf {C}}\) as a black-box oracle, how much can we learn of its internal working by simply querying it? To formulate and answer this question computationally, we propose a novel framework that explicitly identifies and delineates the computer vision and machine learning components, and we propose an effective deconstruction algorithm for deconstructing binary classifiers with the typical two-component design that employ support vector machine or cascade of linear classifiers as their internal feature classifiers. The deconstruction algorithm simultaneously searches over a collection of candidate feature spaces by probing the spaces for the decision boundaries, using the labels provided by the given classifier. In particular, we demonstrate that it is possible to ascertain the type of kernel function used by the classifier and the number of support vectors (and the subspace spanned by the support vectors) using only image queries and ascertain the unknown feature space too. Furthermore, again using only simple image queries, we are able to completely deconstruct OpenCV’s pedestrian detector, ascertain the exact feature used, the type of classifier employed and recover the (almost) exact linear classifier.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
For simplicity, we assume that the transform \(f_i\) is surjective and as a set (of images), \(f_i^{-1}(v_i)\) is nonempty and we can compute an element (image) in \(f_i^{-1}(v_i) (e.g.,\) [11]).
- 2.
This part is beyond the scope of this paper.
References
Ali, M., Rushdi, M., Ho, J.: Deconstructing kernel machines. In: Calders, T., Esposito, F., Hüllermeier, E., Meo, R. (eds.) ECML PKDD 2014, Part I. LNCS, vol. 8724, pp. 34–49. Springer, Heidelberg (2014)
LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998)
Benenson, R., Mathias, M., Timofte, R., Van Gool, L.: Pedestrian detection at 100 frames per second. In: CVPR (2012)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1, p. I-511. IEEE (2001)
Fei-Fei, L., Perona, P.: A bayesian hierarchical model for learning natural scene categories. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 2, pp. 524–531. IEEE (2005)
Bosch, A., Zisserman, A., Muñoz, X.: Scene classification via pLSA. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 517–530. Springer, Heidelberg (2006)
Lowd, D., Meek, C.: Adversarial learning. In: Proceedings of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery in Data Mining, pp. 641–647. ACM (2005)
Dasgupta, S.: Analysis of a greedy active learning strategy. In: Advances in Neural Information Processing Systems (2004)
Balcan, M., Beygelzimer, A., Langford, J.: Agnostic active learning. In: Proceedings of the International Conference Machine Learning (ICML) (2006)
Balcan, M.-F., Broder, A., Zhang, T.: Margin based active learning. In: Bshouty, N.H., Gentile, C. (eds.) COLT. LNCS (LNAI), vol. 4539, pp. 35–50. Springer, Heidelberg (2007)
Vondrick, C., Khosla, A., Malisiewicz, T., Torralba, A.: Hoggles: Visualizing object detection features. In: Proceedings of the International Conference on Computer Vision (2013)
Heath, M.: Scientific Computing. The McGraw-Hill Companies Inc., New York (2002)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 886–893. IEEE (2005)
Lowe, D.G.: Object recognition from local scale-invariant features. In: The Proceedings of the Seventh IEEE International Conference on Computer vision, vol. 2, pp. 1150–1157. IEEE (1999)
Fei-Fei, L., Fergus, R., Perona, P.: One-shot learning of object categories. IEEE Trans. Pattern Anal. Mach. Intell. 28, 594–611 (2006)
Bradski, G.: The OpenCV library. Dr. Dobb’s J. Softw. Tools 25, 120–126 (2000)
Tsochantaridis, I., Hofmann, T., Joachims, T., Altun, Y.: Support vector machine learning for interdependent and structured output spaces. In: Proceedings of the Twenty-First International Conference on Machine Learning, p. 104. ACM (2004)
Mairal, J., Bach, F., Ponce, J., Sapiro, G., Zisserman, A.: Discriminative learned dictionaries for local image analysis. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008)
Csurka, G., Dance, C., Fan, L., Willamowski, J., Bray, C.: Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, ECCV, vol. 1, pp. 1–2 (2004)
Bengio, Y.: Learning deep architectures for ai. Found. Trends\(\textregistered \) Mach. Learn. 2, 1–127 (2009)
Hinton, G.E., Osindero, S., Teh, Y.W.: A fast learning algorithm for deep belief nets. Neural Comput. 18, 1527–1554 (2006)
Acknowledgement
We in particular would like to thank one of the reviewers for his/her helpful comment and enthusiasm for our paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Ali, M., Ho, J. (2015). Deconstructing Binary Classifiers in Computer Vision. In: Cremers, D., Reid, I., Saito, H., Yang, MH. (eds) Computer Vision -- ACCV 2014. ACCV 2014. Lecture Notes in Computer Science(), vol 9005. Springer, Cham. https://doi.org/10.1007/978-3-319-16811-1_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-16811-1_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16810-4
Online ISBN: 978-3-319-16811-1
eBook Packages: Computer ScienceComputer Science (R0)