Perceptual Color Classification Based on Lightning Environment with Hyperspectral Data

  • Yuko OzasaEmail author
  • Kenji Iwata
  • Naoko Enami
  • Yutaka Satou
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10116)


Identifying objects by its color name is an essential capability for a service robot to understand and interact with the physical world and be of use in everyday life scenarios. The robot uses an image for the identification, but the image is strongly affected by lightning environment while human does not affected by the environment when they decide its color name. We present lightning environment estimation and perceptual color classification based on the estimation using hyperspectral data. Support Vector Machine (SVM) or Multiple Kernel Learning SVM is used for the estimation and classification. Originality of our paper is that the hyperspectral data is used for both lightning environment estimation and perceptual color classification of an object. Suppose that the lightning environment is given, the perceptual color of the object is classified in each environment. Additionally, perceptual color is estimated by using result of the lightning environment estimation. A novel dataset which consists of the hyperspectral image of 15 objects taken in 4 different lightning environments is constructed in our experiment. Experimental result of the hyperspectral data are compared by those of common color spaces, such as RGB and L*a*b. The estimation and classification with SVM and MKL SVM are compared in the experiments. From the experimental results, hyperspectral data enabled us to present a separated scheme which consists of the lightning environment estimation and perceptual color classification while previous color spaces could not.


Support Vector Machine Color Space Hyperspectral Image Perceptual Color Service Robot 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Özgen, E., Davies, I.R.: Acquisition of categorical color perception: a perceptual learning approach to the linguistic relativity hypothesis. J. Exp. Psychol. Gen. 131, 477 (2002)CrossRefGoogle Scholar
  2. 2.
    HaCohen, Y., Shechtman, E., Goldman, D.B., Lischinski, D.: Optimizing color consistency in photo collections. ACM Trans. Graph. (TOG) 32, 38 (2013)CrossRefGoogle Scholar
  3. 3.
    Graf, B., Hans, M., Schraft, R.D.: Care-o-bot II: development of a next generation robotic home assistant. Auton. Robots 16, 193–205 (2004)CrossRefGoogle Scholar
  4. 4.
    Sun, Y., Bo, L., Fox, D.: Attribute based object identification. In: Proceedings of 2013 International Conference on the Robotics and Automation (ICRA), pp. 2096–2103. IEEE (2013)Google Scholar
  5. 5.
    Fang, R., Liu, C., Chai, J.Y.: Integrating word acquisition and referential grounding towards physical world interaction. In: Proceedings of 2012 International Conference on Multimodal Interaction (ICMI), pp. 109–116. ACM (2012)Google Scholar
  6. 6.
    Brelstaff, G.J., Párraga, A., Troscianko, T., Carr, D.: Hyperspectral camera system: acquisition and analysis. In: International Society for Optics and Photonics, Satellite Remote Sensing, vol. II, pp. 150–159 (1995)Google Scholar
  7. 7.
    Mehl, P.M., Chen, Y.R., Kim, M.S., Chan, D.E.: Development of hyperspectral imaging technique for the detection of apple surface defects and contaminations. J. Food Eng. 61, 67–81 (2004)CrossRefGoogle Scholar
  8. 8.
    EBA Japan Co., Ltd.: (Hyper spectrum camera nh-7).
  9. 9.
    Camps-Valls, G., Bruzzone, L.: Kernel-based methods for hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 43, 1351–1362 (2005)CrossRefGoogle Scholar
  10. 10.
    Shah, C., Watanachaturaporn, P., Varshney, P., Arora, M.: Some recent results on hyperspectral image classification. In: 2003 IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, pp. 346–353. IEEE (2003)Google Scholar
  11. 11.
    Mourao-Miranda, J., Friston, K.J., Brammer, M.: Dynamic discrimination analysis: a spatial-temporal SVM. NeuroImage 36, 88–99 (2007)CrossRefGoogle Scholar
  12. 12.
    Bach, F.R., Lanckriet, G.R., Jordan, M.I.: Multiple kernel learning, conic duality, and the SMO algorithm. In: Proceedings of the Twenty-First International Conference on Machine Learning, vol. 6. ACM (2004)Google Scholar
  13. 13.
    Tuia, D., Camps-Valls, G., Matasci, G., Kanevski, M.: Learning relevant image features with multiple-kernel classification. IEEE Trans. Geosci. Remote Sens. 48, 3780–3791 (2010)CrossRefGoogle Scholar
  14. 14.
    Sonnenburg, S., Rätsch, G., Schäfer, C., Schölkopf, B.: Large scale multiple kernel learning. J. Mach. Learn. Res. 7, 1531–1565 (2006)MathSciNetzbMATHGoogle Scholar
  15. 15.
    Reinhard, E., Ashikhmin, M., Gooch, B., Shirley, P.: Color transfer between images. IEEE Comput. Graph. Appl. 21, 34–41 (2001)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Yuko Ozasa
    • 1
    Email author
  • Kenji Iwata
    • 2
  • Naoko Enami
    • 3
  • Yutaka Satou
    • 2
  1. 1.Faculty of Science and TechnologyKeio UniversityYokohamaJapan
  2. 2.National Institute of Advanced Industrial Science and Technology (AIST)TsukubaJapan
  3. 3.Organization of Advanced Science and TechnologyKobe UniversityKobeJapan

Personalised recommendations