Abstract
Having perceptual differences between scene colors is key in many computer vision applications such as image segmentation or visual salient region detection. Nevertheless, most of the times, we only have access to the rendered image colors, without any means to go back to the true scene colors. The main existing approaches propose either to compute a perceptual distance between the rendered image colors, or to estimate the scene colors from the rendered image colors and then to evaluate perceptual distances. However the first approach provides distances that can be far from the scene color differences while the second requires the knowledge of the acquisition conditions that are unavailable for most of the applications. In this paper, we design a new local Mahalanobis-like metric learning algorithm that aims at approximating a perceptual scene color difference that is invariant to the acquisition conditions and computed only from rendered image colors. Using the theoretical framework of uniform stability, we provide consistency guarantees on the learned model. Moreover, our experimental evaluation shows its great ability (i) to generalize to new colors and devices and (ii) to deal with segmentation tasks.
Chapter PDF
Similar content being viewed by others
References
Achanta, R., Susstrunk, S.: Saliency detection using maximum symmetric surround. In: Proc. of ICIP, Hong Kong, pp. 2653–2656 (2010)
Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE Trans. on PAMI 33(5), 898–916 (2011)
Bellet, A., Habrard, A., Sebban, M.: A survey on metric learning for feature vectors and structured data (arxiv:1306.6709v3). Tech. rep. (August 2013)
Bitsakos, K., Fermüller, C., Aloimonos, Y.: An experimental study of color-based segmentation algorithms based on the mean-shift concept. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part II. LNCS, vol. 6312, pp. 506–519. Springer, Heidelberg (2010)
Bousquet, O.: Stability and generalization. JMLR 2, 499–526 (2002)
Burghouts, G.J., Geusebroek, J.-M.: Performance evaluation of local colour invariants. Computer Vision and Image Understanding 113 (1), 48–62 (2009)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proc. of CVPR, pp. 886–893 (2005)
Davis, J.V., Kulis, B., Jain, P., Sra, S., Dhillon, I.S.: Information-theoretic metric learning. In: Proc. of ICML, pp. 209–216 (2007)
Huang, M., Liu, H., Cui, G., Luo, M.R., Melgosa, M.: Evaluation of threshold color differences using printed samples. JOSA A 29(6), 883–891 (2012)
Huang, Y., Li, C., Georgiopoulos, M., Anagnostopoulos, G.C.: Reduced-rank local distance metric learning. In: Blockeel, H., Kersting, K., Nijssen, S., Železný, F. (eds.) ECML PKDD 2013, Part III. LNCS, vol. 8190, pp. 224–239. Springer, Heidelberg (2013)
Khan, R., van de Weijer, J., Khan, F., Muselet, D., Ducottet, C., Barat, C.: Discriminative color descriptor. In: Proc. of CVPR, Portland, USA (2013)
Kim, S.J., Lin, H.T., Lu, Z., Süsstrunk, S., Lin, S., Brown, M.S.: A new in-camera imaging model for color computer vision and its application. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2289–2302 (2012)
Kim, S.J., Lin, H.T., Lu, Z., Susstrunk, S., Lin, S., Brown, M.S.: A new in-camera imaging model for color computer vision and its application. IEEE Trans. on PAMI 34(12), 2289–2302 (2012)
Larraín, R.E., Schaefer, D.M., Reed, J.D.: Use of digital images to estimate {CIE} color coordinates of beef. Food Research Int. 41(4), 380 (2008)
León, K., Mery, D., Pedreschi, F., León, J.: Color measurement in l*a*b* units from rgb digital images. Food Research Int. 39(10), 1084–1091 (2006)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. IJCV 60(2), 91–110 (2004)
Melgosa, M., Huertas, R., Berns, R.S.: Performance of recent advanced color-difference formulas using the standardized residual sum of squares index. JOSA A 25(7), 1828–1834 (2008)
Mojsilovic, A.: A computational model for color naming and describing color composition of images. IEEE Trans. on Image Processing 14(5), 690–699 (2005)
Munsell, A.H.: A pigment color system and notation. The American Journal of Psychology 23(2), 236–244 (1912)
van de Sande, K.E.A., Gevers, T., Snoek, C.G.M.: Evaluating color descriptors for object and scene recognition. IEEE Trans. on PAMI 32(9), 1582–1596 (2010)
Semerci, M., Alpaydın, E.: Mixtures of large margin nearest neighbor classifiers. In: Blockeel, H., Kersting, K., Nijssen, S., Železný, F. (eds.) ECML PKDD 2013, Part II. LNCS, vol. 8189, pp. 675–688. Springer, Heidelberg (2013)
Sharma, G., Wu, W., Dalal, E.N.: The ciede2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations. Color Research Applications 30, 21–30 (2005)
Stokes, M., Anderson, M., Chandrasekar, S., Motta, R.: A standard default color space for the internet: sRGB. Tech. rep., Hewlett-Packard and Microsoft (1996), http://www.w3.org/Graphics/Color/sRGB.html
Union, I.T.: Parameter values for the hdtv standards for production and international programme exchange, itu-r recommendation bt.709-4. Tech. rep (March 2000)
van der Vaart, A.W., Wellner, J.A.: Weak convergence and empirical processes. Springer, Heidelberg (2000)
Wang, J., Kalousis, A., Woznica, A.: Parametric local metric learning for nearest neighbor classification. In: Proc. of NIPS, pp. 1610–1618 (2012)
Gevers, T., van de Weijer, A.D.B.J.: Boosting color saliency in image feature detection. IEEE Trans. on PAMI 28(1), 150–156 (2006)
Gevers, T., van de Weijer, J.M.G.J.: Edge and corner detection by photometric quasi-invariants. IEEE Trans. on PAMI 27(4), 1520–1526 (2005)
Weinberger, K.Q., Blitzer, J., Saul, L.: Distance metric learning for large margin nearest neighbor classification. In: Proc. of NIPS (2006)
Weinberger, K.Q., Saul, L.K.: Distance metric learning for large margin nearest neighbor classification. JMLR 10, 207–244 (2009)
Wyszecki, G., Stiles, W.S.: Color Science: Concepts and Methods, Quantitative Data and Formulas, 2nd revised ed. John Wiley & Sons Inc. (2000)
Xing, E.P., Ng, A.Y., Jordan, M.I., Russell, S.: Distance metric learning, with application to clustering with side-information. In: Proc. NIPS, pp. 505–512 (2002)
Xiong, C., Johnson, D., Xu, R., Corso, J.J.: Random forests for metric learning with implicit pairwise position dependence. In: Proc. of KDD, pp. 958–966. ACM (2012)
Xiong, Y., Saenko, K., Darrell, T., Zickler, T.: From pixels to physics: Probabilistic color de-rendering. In: Proc. of CVPR, Providence, USA (2012)
Xu, H., Mannor, S.: Robustness and Generalization. Machine Learning 86(3), 391–423 (2012)
Xue, W., Mou, X., Zhang, L., Feng, X.: Perceptual fidelity aware mean squared error. In: Proc. of ICCV (2013)
Freely avaible on the authors’ personal web pages
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
1 Electronic Supplementary Material
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Perrot, M., Habrard, A., Muselet, D., Sebban, M. (2014). Modeling Perceptual Color Differences by Local Metric Learning. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8693. Springer, Cham. https://doi.org/10.1007/978-3-319-10602-1_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-10602-1_7
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10601-4
Online ISBN: 978-3-319-10602-1
eBook Packages: Computer ScienceComputer Science (R0)