Skip to main content

Distant Supervision from Knowledge Graphs

  • Reference work entry
  • First Online:
  • 10 Accesses

Synonyms

Self-supervised relation extraction

Overview

In this chapter, we discuss approaches leveraging distant supervision for relation extraction. We start by introducing the key ideas behind distant supervision as well as their main shortcomings. We then discuss approaches that improve over the basic method, including approaches based on the at-least-one-principle along with their extensions for handling false negative labels, and approaches leveraging topic models. We also describe embeddings-based methods including methods leveraging convolutional neural networks. Finally, we discuss how to take advantage of auxiliary information to improve relation extraction.

Definitions

Definition 1

A knowledge graph, or knowledge base, is a semantic network defined as a set of triples (s, p, o) specifying that a node s (subject) is connected to another node o (object) by the property p. Sets of such triples form a directed graph, where nodes in the graph represent the subject and object in...

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   849.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   999.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Alfonseca E, Filippova K, Delort JY, Garrido G (2012) Pattern learning for relation extraction with a hierarchical topic model. In: Proceedings of the 50th annual meeting of the association for computational linguistics: short papers-volume 2. Association for Computational Linguistics, pp 54–59

    Google Scholar 

  • Angeli G, Tibshirani J, Wu J, Manning CD (2014) Combining distant and partial supervision for relation extraction. In: EMNLP, pp 1556–1567

    Google Scholar 

  • Augenstein I, Maynard D, Ciravegna F (2016) Distantly supervised web relation extraction for knowledge base population. Semantic Web 7(4):335–349

    Article  Google Scholar 

  • Chang KW, Yih SWt, Yang B, Meek C (2014) Typed tensor decomposition of knowledge bases for relation extraction. In: Proceedings of the 2014 conference on empirical methods in natural language processing, pp 1568–1579

    Google Scholar 

  • Fan M, Zhao D, Zhou Q, Liu Z, Zheng TF, Chang EY (2014) Distant supervision for relation extraction with matrix completion. In: ACL (1), Citeseer, pp 839–849

    Google Scholar 

  • Han X, Sun L (2016) Global distant supervision for relation extraction. In: Thirtieth AAAI conference on artificial intelligence

    Google Scholar 

  • Hoffmann R, Zhang C, Ling X, Zettlemoyer L, Weld DS (2011) Knowledge-based weak supervision for information extraction of overlapping relations. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies-volume 1. Association for Computational Linguistics, pp 541–550

    Google Scholar 

  • Koch M, Gilmer J, Soderland S, Weld DS (2014) Type-aware distantly supervised relation extraction with linked arguments. In: Proceedings of EMNLP, Citeseer

    Book  Google Scholar 

  • Lin Y, Shen S, Liu Z, Luan H, Sun M (2016) Neural relation extraction with selective attention over instances. In: ACL (1)

    Google Scholar 

  • Min B, Grishman R, Wan L, Wang C, Gondek D (2013) Distant supervision for relation extraction with an incomplete knowledge base. In: HLT-NAACL, pp 777–782

    Google Scholar 

  • Mintz M, Bills S, Snow R, Jurafsky D (2009) Distant supervision for relation extraction without labeled data. In: Proceedings of the joint conference of the 47th annual meeting of the ACL and the 4th international joint conference on natural language processing of the AFNLP: volume 2-volume 2. Association for Computational Linguistics, pp 1003–1011

    Google Scholar 

  • Pershina M, Min B, Xu W, Grishman R (2014) Infusion of labeled data into distant supervision for relation extraction. In: ACL (2), pp 732–738

    Google Scholar 

  • Riedel S, Yao L, McCallum A (2010) Modeling relations and their mentions without labeled text. Mach Learn Knowl Discovery Databases. Springer, pp 148–163

    Google Scholar 

  • Riedel S, Yao L, McCallum A, Marlin BM (2013a) Relation extraction with matrix factorization and universal schemas. Human language technologies: conference of the north american chapter of the association of computational linguistics, pp 74–84

    Google Scholar 

  • Ritter A, Zettlemoyer L, Etzioni O et al (2013b) Modeling missing data in distant supervision for information extraction. Trans Assoc Comput Linguist 1: 367–378

    Article  Google Scholar 

  • Rocktäschel T, Singh S, Riedel S (2015) Injecting logical background knowledge into embeddings for relation extraction. In: HLT-NAACL, pp 1119–1129

    Google Scholar 

  • Surdeanu M, Tibshirani J, Nallapati R, Manning CD (2012) Multi-instance multi-label learning for relation extraction. In: Proceedings of the 2012 joint conference on empirical methods in natural language processing and computational natural language learning. Association for Computational Linguistics, pp 455–465

    Google Scholar 

  • Xu W, Hoffmann R, Zhao L, Grishman R (2013) Filling knowledge base gaps for distant supervision of relation extraction. In: ACL (2), pp 665–670

    Google Scholar 

  • Yao L, Haghighi A, Riedel S, McCallum A (2011) Structured relation discovery using generative models. In: Proceedings of the conference on empirical methods in natural language processing. Association for Computational Linguistics, pp 1456–1466

    Google Scholar 

  • Zeng D, Liu K, Lai S, Zhou G, Zhao J et al (2014) Relation classification via convolutional deep neural network. In: COLING, pp 2335–2344

    Google Scholar 

  • Zeng D, Liu K, Chen Y, Zhao J (2015) Distant supervision for relation extraction via piecewise convolutional neural networks. In: EMNLP, pp 1753–1762

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Philippe Cudré-Mauroux .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Smirnova, A., Audiffren, J., Cudré-Mauroux, P. (2019). Distant Supervision from Knowledge Graphs. In: Sakr, S., Zomaya, A.Y. (eds) Encyclopedia of Big Data Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-77525-8_285

Download citation

Publish with us

Policies and ethics