Fashion Outfit Style Retrieval Based on Hashing Method

  • Yujuan DingEmail author
  • Wai Keung Wong
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 849)


This paper proposes an outfit retrieval method for moving fashion items dressed by models in the catwalk videos. The proposed method aims at retrieving similar style in fashion outfits images using a bilinear supervised hashing algorithm. The targeted images are labeled with the information of both color and attributes for comprehensive description of clothing style. The speed up robust features (SURFs) are extracted as the low-level features of fashion images and fed into the hashing algorithm as original data. To achieve better retrieval performance, a bilinear supervised hashing method is employed to learn high-quality hash codes. Outfits with similar style to the target are expected to be retrieved by hash code ranking. The experiment was conducted on a dataset composed of fashion outfit images and the experimental results show that the proposed method can retrieve styles which are close to query of color and attributes.


Fashion style retrieval Fashion catwalk images Hashing algorithm 



This paper was supported by the Hong Kong Polytechnic University.


  1. 1.
    Liu, Z., Luo, P., Qiu, S., Wang, X., Tang, X.: Deepfashion: powering robust clothes recognition and retrieval with rich annotations. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1096–1104 (2016)Google Scholar
  2. 2.
    Yang, W., Luo, P., Lin, L.: Clothing co-parsing by joint image segmentation and labeling. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3182–3189 (2014)Google Scholar
  3. 3.
    Liu, S., Song, Z., Liu, G., Xu, C., Lu, H., Yan, S.: Street-to-shop: cross-scenario clothing retrieval via parts alignment and auxiliary set. In 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3330–3337 (2012)Google Scholar
  4. 4.
    Matzen, K., Bala, K., Snavely, N.: StreetStyle: exploring world-wide clothing styles from million of photos (2017)Google Scholar
  5. 5.
    Chen, H., Gallagher, A., Girod, B.: Describing clothing by semantic attributes. In: European Conference on Computer Vision, pp. 609–623 (2012)CrossRefGoogle Scholar
  6. 6.
    Di, W., Wah, C., Bhardwaj, A., Piramuthu, R., Sundaresan, N.: Style finder: fine-grained clothing style detection and retrieval. In: 2013 IEEE Conference on, Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 8–13 (2013)Google Scholar
  7. 7.
    Chen, Q., Huang, J., Feris, R., Brown, L.M., Dong, J., Yan, S.: Deep domain adaptation for describing people based on fine-grained clothing attributes. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5315–5324 (2015)Google Scholar
  8. 8.
    Jie, X., Mok, P.Y., Yuen, C.W.M., Yee, R.W.Y.: A web-based design support system for fashion technical sketches. Int. J. Clothing Sci. Technol. 28, 130–160 (2016)Google Scholar
  9. 9.
    Jia, J., Huang, J., Shen, G., He, T., Liu, Z., Luan, H.-B. et al.: Learning to appreciate the aesthetic effects of clothing. In: AAAI, pp. 1216–1222 (2016)Google Scholar
  10. 10.
    Kiapour, M.H., Yamaguchi, K., Berg, A.C., Berg, T.L.: Hipster wars: discovering elements of fashion styles. In: European Conference on Computer Vision, pp. 472–488 (2014)Google Scholar
  11. 11.
    Simo-Serra, E., Ishikawa, H.: Fashion style in 128 floats: joint ranking and classification using weak data for feature extraction. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 298–307 (2016)Google Scholar
  12. 12.
    Wang, X., Jia, J., Yin, J., Cai, L.: Interpretable aesthetic features for affective image classification. In: 2013 IEEE International Conference on Image Processing, pp. 3230–3234 (2013)Google Scholar
  13. 13.
    Wang, B., Yu, Y., Wong, T.-T., Chen, C., Xu, Y.-Q.: Data-driven image color theme enhancement. ACM Trans. Graph. 29, 1–10 (2010) Google Scholar
  14. 14.
    Ma, Y., Jia, J., Zhou, S., Fu, J., Liu, Y., Tong, Z.: Towards better understanding the clothing fashion styles: a multimodal deep learning approach. In: AAAI, pp. 38–44 (2017)Google Scholar
  15. 15.
    Cui, Y., Jiang, J., Lai, Z., Hu, Z., Wong, W.: Supervised discrete discriminant hashing for image retrieval. Pattern Recognit. 78, 79–90 (2018)CrossRefGoogle Scholar
  16. 16.
    Shen, F., Shen, C., Liu, W., Tao Shen, H.: Supervised discrete hashing. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 37–45 (2015)Google Scholar
  17. 17.
    Wang, J., Zhang, T., Sebe, N., Shen, H.T.: A survey on learning to hash. IEEE Trans. Pattern Anal. Mach. Intell. 40, 769–790 (2018)CrossRefGoogle Scholar
  18. 18.
    Weiss, Y., Torralba, A., Fergus, R.: Spectral hashing. In: Advances in Neural Information Processing Systems, pp. 1753–1760 (2009)Google Scholar
  19. 19.
    Gong, Y., Kumar, S., Rowley, H.A., Lazebnik, S.: Learning binary codes for high-dimensional data using bilinear projections. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 484–491 (2013)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Institute of Textiles and ClothingThe Hong Kong Polytechnic UniversityHong KongHong Kong

Personalised recommendations