Soft Computing

, Volume 23, Issue 3, pp 1007–1020 | Cite as

Emotion-based color transfer of images using adjustable color combinations

  • Yuan-Yuan Su
  • Hung-Min SunEmail author
Methodologies and Application


This study developed a novel framework for the color transfer between color images, which can further achieve emotion transfer between color images based on the human emotion (human feeling) or a predefined color-emotion model. In the study, we propose a new skill, which makes it possible to adjust the amount of main colors in image according to the complexity of the content of images. It can improve the previous methods which merely take single main color or the fix number of main colors combinations to implement color transfer. Other contributions of the study are the algorithms of the TFS and the TUS, which can improve the identification of the background and foreground and the other main colors that are extracted from the images. The category of images in this study focuses on the color images, such as scenic photographs, still life images, paintings, and wallpaper. The proposed method can also aid those non-professionals to manipulate and describe the connection between colors and emotion in a more objective and precise way. Potential applications include advertising design, cover design, clothing matching on color, interior design, colorization of grayscale images, and re-emotion the photograph of the camera.


Emotion-transfer Color-transfer Color-emotion Predefined color-emotion model 



This research was supported in part by the Ministry of Science and Technology, Taiwan, under the Grants MOST-104-2221-E-007-071-MY3.

Compliance with ethical standards

Conflict of interest

All authors declare that they have no conflicts of interest regarding the publication of this manuscript.


  1. Amara (2016) The complete guide to color psychology. Accessed 2016
  2. Chang Y, Saito S, Uchikawa K, Nakajima M (2005) Example-based color stylization of images. ACM Trans Appl Percept 2(3):322345CrossRefGoogle Scholar
  3. Chiou W-C, Chen Y-L, Hsu C-T (2010) Color transfer for complex content images based on intrinsic component. In: IEEE international workshop on multimedia signal processing (MMSP), pp 156–161Google Scholar
  4. Chou C-K (2011) Color scheme Bible compact edition. Grandtech Information Co., Ltd, TaipeiGoogle Scholar
  5. CIELAB (2016) CIELab—Color models technical guides. Accessed 2016
  6. Csurka G, Ska S, Marchesotti L, Saunders C (2010) Learning moods and emotions from color combinations. In: Proceedings of the seventh Indian conference on computer vision, graphics and image processing, ICVGIP 10, ACM, New York, NY, USA, pp 298–305Google Scholar
  7. Dellagiacoma M, Zontone P, Boato G (2011) Emotion based classification of natural images, DETECT11, Glasgow, Scotland, UK. Copyright 2011 ACM 978-1-4503-0962-2/11/10Google Scholar
  8. Dong W, Bao G, Zhang X, Paul J-C (2010) Fast local color transfer via dominant colors mapping. In: ACM SIGGRAPH ASIA 2010 Sketches, SA 10, ACM, New York, NY, USA, pp 461–462Google Scholar
  9. Eisemann L (2000) Pantones guide to communicating with color. Grax Press, LondonGoogle Scholar
  10. Eysenck HJ (1941) A critical and experimental study of color preferences. Am J Psychol 54:385394CrossRefGoogle Scholar
  11. Foley JD, Dam AV, Feiner Sk, Hughes JE (1990) Computer graphics: principles and practice. Addison-Wesley, ReadingGoogle Scholar
  12. Gray R (1984) Vector quantization. IEEE ASSP Mag 1:4–29Google Scholar
  13. Hartigan JA, Wong MA (1979) Algorithm AS 136: a K-means clustering algorithm. J R Stat Soc Ser C 28(1): 100–108. JSTOR 2346830Google Scholar
  14. I.R.I. (2011) The color for designer. DrSmart Press Co., Ltd., New Taipei CityGoogle Scholar
  15. Itten J (1962) Art of colour. Van Nostrand Reinhold, New YorkGoogle Scholar
  16. Kobayashi S (1992) Color Image Scale. Kodansha InternationalGoogle Scholar
  17. Krishnan N, M.S Univ., Washington, Banu MS, Callins Christiyana C (2007) Content based image retrieval using dominant color identification based on foreground objects, conference on computational intelligence and multimedia applications. International conference on (vol 3)Google Scholar
  18. Lanata Antonio, Valenza Gaetano, Scilingo Enzo Pasquale (2013) Eye gaze patterns in emotional pictures. J Ambient Intell Hum Comput 4:705715CrossRefGoogle Scholar
  19. Lee J, Cheon Y-M, Kim S-Y, Park E-J (2007) Emotional evaluation of color patterns based on rough sets. In: Natural computation. Third international conference on ICNC 2007, vol 1, pp 140–144Google Scholar
  20. Lee T, Lim H, Kim D-W, Hwang S, Yoon K (2016) System for matching paintings with music based on emotions. ACM SIGGRAPH ASIA 2016 technical briefs (November 2016). doi: 10.1145/3005358.300536
  21. Li M-T, Huang M-L, Wang C-M (2010) Example based color alternation for images. In: Computer engineering and technology (ICCET) 2nd international conference on, vol 7, pp V7316–V7320Google Scholar
  22. Lin Hao-Chiang Koong, Hsieh Min-Chai, Loh Li-Chen, Wang Cheng-Hung (2012) An emotion recognition mechanism based on the combination of mutual information and semantic clues. J Ambient Intell Hum Comput 3:1929CrossRefGoogle Scholar
  23. Linde Y, Buzo A, Gray RM (1980) An algorithm for vector quantizer design. IEEE Trans Commun 28:84–95CrossRefGoogle Scholar
  24. Mao X, Chen B, Muta I (2003) Affective property of image and fractal dimension. Chaos Solitons Fractals 15(5):905910CrossRefzbMATHGoogle Scholar
  25. Neumann L, Neumann A (2005) Color style transfer techniques using hue, lightness and saturation histogram matching, in computational aesthetics in graphics. Vis Imaging 2005:111–122Google Scholar
  26. Norman RD, Scott WA (1952) Colour and aect: a review and semantic evaluation. J Gen Psychol 46:185233CrossRefGoogle Scholar
  27. Ou L-C, Luo MR, Woodcock A, Wright A (2004) Colour emotions for single colours, in Part I of A study of colour emotion and colour preference. Color Res Appl 29:232240Google Scholar
  28. Ou L-C, Luo MR, Woodcock A, Wright A (2004) Colour emotions for two-colour combinations, in Part II of A study of colour emotion and colour preference. Color Res Appl 29:292298Google Scholar
  29. Pan Chen, Park Dong Sun, Huijuan Lu, Xiangping Wu (2012) Color image segmentation by fixationbased active learning with ELM. Soft Comput 16:15691584CrossRefGoogle Scholar
  30. Pitie F, Kokaram A, Dahyot R (2005) N-dimensional probability density function transfer and its application to color transfer. In: Computer vision, ICCV 2005. International conference on tenth IEEE, vol 2, pp 1434–1439Google Scholar
  31. Pouli T, Reinhard E (2011) Progressive histogram reshaping for creative color transfer and tone reproduction. Comput Graph 35(1):67–80CrossRefGoogle Scholar
  32. Pouli T, Reinhard E (2011) Progressive color transfer for images of arbitrary dynamic range. Comput Graph 35:6780. Extended Papers from NonPhotorealistic Animation and Rendering (NPAR)Google Scholar
  33. Qi H, Zaretzki R (2015) Image color transfer to evoke different emotions based on color combinations. SIViP 9:19651973Google Scholar
  34. Reinhard M, Ashikhmin B Gooch, Shirley P (2001) Color transfer between images. IEEE Comput Graph 3441Google Scholar
  35. Sato T, Kajiwara K, Hoshino H, Nakamura T (2000) Quantitative evaluation and categorizing of human emotion induced by colour. In: Advances in colour science and technology vol 3, pp 5359. Simon McArdle, Accessed 2016, Psychology of Color In Logo Design, internet:
  36. Su YY, Chang CC (2002) A New Approach of Color Image Quantization Based on Multi-Dimensional Directory, VRAI 2002. China, Hangzhou, pp 508–514Google Scholar
  37. Tai Y-W, Jia J, Tang C-K (2005) Local color transfer via probabilistic segmentation by expectation maximization. IEEE Computer Society Conference on Computer Vision and Pattern Recognition vol 1, pp 747–754Google Scholar
  38. Tanaka S, Iwadate Y, Inokuchi S (2000) An attractiveness evaluation model based on the physical features of image regions. In: Proceedings, 15th international conference on pattern recognitionGoogle Scholar
  39. Wang B, Yu Y, Wong T-T, Chen C, Xu Y-Q (2010) Data-driven image color theme enhancement. ACM Trans Graph 29:6. Article 146 (December 2010), 10 pages. doi: 10.1145/1882261.1866172
  40. Wei-Ning W, Ying-Lin Y, Sheng-ming J (2006) Image retrieval by emotional semantics: a study of emotional space and feature extraction. In: Systems, man and cybernetics. IEEE international conference on SMC 06, vol 4, pp 3534–3539Google Scholar
  41. Whelan BM (1994) Color Harmony 2: a guide to creative color combinations. Rockport Publishers, BeverlyGoogle Scholar
  42. Wu Fuzhang, Dong Weiming, Kong Yan, Mei Xing, Paul Jean-Claude, Zhang Xiaopeng (2013) Content based color transfer. Comput Graph Forum 32(1):190203CrossRefGoogle Scholar
  43. Xiao X, Ma L (2009) Gradient-preserving color transfer. Comput Graph Forum 18:791–886Google Scholar
  44. Xiao X, Ma L (2006) Color transfer in correlated color space. In: Proceedings of the 2006 ACM international conference on virtual reality continuum and its applications, VRCIA 06, ACM, New York, NY, USA, pp 305–309Google Scholar
  45. Yang C-K, Peng L-K (2008) Automatic mood transferring between color images. IEEE Comput Graph Appl 28:5261Google Scholar
  46. Zang Y, Huang H, Li C-F (2010) Example-based painting guided by colorfeatures. Vis Comput 26(6–8):933–942Google Scholar
  47. Zhanga Ming, Zhanga Ke, Fenga Qinghe, Wanga Jianzhong, Konga Jun, Lua Yinghua (2014) A novel image retrieval method based on hybrid information descriptors. J Vis Commun Image Represent 25(7):15741587Google Scholar
  48. Zhang L, Li K (2016) Adaptive image segmentation based on color clustering for person re-identification. Soft Comput. doi: 10.1007/s00500-016-2150-x

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2017

Authors and Affiliations

  1. 1.Department of Computer ScienceNational Tsing Hua UniversityHsinchuTaiwan
  2. 2.Research Center for Information Technology Innovation, Academia, Sinica, TaiwanHsinchuTaiwan

Personalised recommendations