Skip to main content

Deep Domain Generalization

  • Chapter
  • First Online:
Learning Representation for Multi-View Data Analysis

Part of the book series: Advanced Information and Knowledge Processing ((AI&KP))

  • 1167 Accesses

Abstract

Conventional domain adaptation assumes that target data are still accessible in the training stage. However, we would always confront such cases in reality that the target data are totally blind in the training stage. This is extremely challenging since we have no prior knowledge of the target. Most recently, domain generalization has been well exploited to fight off the challenge through capturing knowledge from multiple source domains and generalizing to the unseen target domains. However, existing domain generalization research efforts all employ shallow structures, so it is difficult for them to well uncover the rich information within the complex data. Therefore, it is easy to ignore the useful knowledge shared by multiple sources and hard to adapt the knowledge to the unseen target domains in the test stage.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.cs.dartmouth.edu/~chenfang/proj_page/FXR_iccv13/index.php.

  2. 2.

    http://vc.sce.ntu.edu.sg/transfer_learning_domain_adaptation/.

  3. 3.

    http://vasc.ri.cmu.edu/idb/html/face/.

References

  • Ahmed E, Jones M, Marks TK (2015) An improved deep learning architecture for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3908–3916

    Google Scholar 

  • Chang C-C, Lin C-J (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):27

    Article  Google Scholar 

  • Ding Z, Shao M, Fu Y (2014) Latent low-rank transfer subspace learning for missing modality recognition. In: Twenty-eighth AAAI conference on artificial intelligence

    Google Scholar 

  • Ding Z, Fu Y (2018) Deep domain generalization with structured low-rank constraint. IEEE Trans Image Process 27(1):304–313

    Article  MathSciNet  Google Scholar 

  • Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution. In: European conference on computer vision. Springer, pp 184–199

    Google Scholar 

  • Fang C, Xu Y, Rockmore DN (2013) Unbiased metric learning: on the utilization of multiple datasets and web images for softening bias. In: IEEE international conference on computer vision. IEEE, pp 1657–1664

    Google Scholar 

  • Ghifary M, Kleijn WB, Zhang M, Balduzzi D (2015) Domain generalization for object recognition with multi-task autoencoders. In: IEEE international conference on computer vision (2015)

    Google Scholar 

  • Gong B, Shi Y, Sha F, Grauman K (2012) Geodesic flow kernel for unsupervised domain adaptation. In: IEEE conference on computer vision and pattern recognition, pp 2066–2073

    Google Scholar 

  • Hu J, Lu J, Tan Y-P (2015) Deep transfer metric learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 325–333

    Google Scholar 

  • Jhuo I-H, Liu D, Lee DT, Chang S-F (2012) Robust visual domain adaptation with low-rank reconstruction. In: IEEE conference on computer vision and pattern recognition, pp 2168–2175

    Google Scholar 

  • Khosla A, Zhou T, Malisiewicz T, Efros AA, Torralba A (2012) Undoing the damage of dataset bias. In: European conference on computer vision. Springer, pp 158–171

    Google Scholar 

  • Liu G, Zhouchen L, Yan S, Sun J, Yu Y, Yi M (2013) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–184

    Article  Google Scholar 

  • Long M, Wang J, Ding G, Sun J, Yu P (2014) Transfer joint matching for unsupervised domain adaptation. In: IEEE conference on computer vision and pattern recognition, pp 1410–1417

    Google Scholar 

  • Lu J, Wang G, Deng W, Moulin P, Zhou J (2015) Multi-manifold deep metric learning for image set classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1137–1145

    Google Scholar 

  • Nadaraya EA (1964) On estimating regression. Theory Probab Its Appl 9(1):141–142

    Article  Google Scholar 

  • Niu L, Li W, Xu D (2015) Visual recognition by learning from web data: A weakly supervised domain generalization approach. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2774–2783

    Google Scholar 

  • Ouyang W, Wang X, Zeng X, Qiu S, Luo P, Tian Y, Li H, Yang S, Wang Z, Loy C-C, et al (2015) DeepID-Net: deformable deep convolutional neural networks for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2403–2412

    Google Scholar 

  • Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359

    Article  Google Scholar 

  • Rahmani H, Mian A (2015) Learning a non-linear knowledge transfer model for cross-view action recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2458–2466

    Google Scholar 

  • Raj A, Namboodiri VP, Tuytelaars T (2015) Subspace alignment based domain adaptation for RCNN detector. In: 26th British machine vision conference

    Google Scholar 

  • Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 815–823

    Google Scholar 

  • Shekhar S, Patel VM, Nguyen HV, Chellappa R (2013) Generalized domain-adaptive dictionaries. In: IEEE conference on computer vision and pattern recognition, pp 361–368

    Google Scholar 

  • Sun Y, Chen Y, Wang X, Tang X (2014) Deep learning face representation by joint identification-verification. In: Advances in neural information processing systems, pp 1988–1996

    Google Scholar 

  • Sun Y, Wang X, Tang X (2015) Deeply learned face representations are sparse, selective, and robust. In: Proceedings of IEEE computer conference on computer vision and patter recognition

    Google Scholar 

  • Torralba A, Efros A et al (2011) Unbiased look at dataset bias. In: Proceedings of IEEE conference on computer vision and pattern recognition. IEEE, pp 1521–1528

    Google Scholar 

  • Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol PA (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371–3408

    Google Scholar 

  • Wang J, Yang J, Yu K, Lv F, Huang T, Gong Y (2010) Locality-constrained linear coding for image classification. In: IEEE conference on computer vision and pattern recognition. IEEE, pp 3360–3367

    Google Scholar 

  • Xu Z, Li W, Niu L, Xu D (2014) Exploiting low-rank structure from latent domains for domain generalization. In: European conference on computer vision. Springer, pp 628–643

    Google Scholar 

  • Zhang X, Yu FX, Chang S-F, Wang S (2015) Deep transfer network: unsupervised domain adaptation. arXiv:1503.00591

    Google Scholar 

  • Zhuang F, Cheng X, Luo P, Pan SJ, He Q (2015) Supervised representation learning: transfer learning with deep autoencoders. In: Proceedings of the twenty-fourth international joint conference on artificial intelligence, pp 4119–4125

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhengming Ding .

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ding, Z., Zhao, H., Fu, Y. (2019). Deep Domain Generalization. In: Learning Representation for Multi-View Data Analysis. Advanced Information and Knowledge Processing. Springer, Cham. https://doi.org/10.1007/978-3-030-00734-8_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00734-8_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00733-1

  • Online ISBN: 978-3-030-00734-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics