Advertisement

A Neural Approach to Entity Linking on Wikidata

  • Alberto CetoliEmail author
  • Stefano Bragaglia
  • Andrew D. O’Harney
  • Marc Sloan
  • Mohammad Akbari
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11438)

Abstract

We tackle Named Entity Disambiguation (NED) by comparing entities in short sentences with Wikidata graphs. Creating a context vector from graphs through deep learning is a challenging problem that has never been applied to NED. Our main contribution is to present an experimental study of recent neural techniques, as well as a discussion about which graph features are most important for the disambiguation task. In addition, a new dataset (Wikidata-Disamb) is created to allow a clean and scalable evaluation of NED with Wikidata entries, and to be used as a reference in future research. In the end our results show that a Bi-directional Long Short-TermMemory (Bi-LSTM) encoding of the graph triplets performs best, improving upon the baseline models and scoring an F1 value of 91.6% on the Wikidata-Disamb test set (The dataset and the code (with configurations) for this paper can be found at https://github.com/contextscout/ned-graphs).

Keywords

Named Entity Disambiguation Graphs Wikidata RNN GCN 

Notes

Acknowledgements

This work was partially supported by InnovateUK grant Ref. 103677.

References

  1. 1.
    Artiles, J., Amigó, E., Gonzalo, J.: The role of named entities in web people search, vol. 2, p. 534 (2009).  https://doi.org/10.3115/1699571.1699582, http://portal.acm.org/citation.cfm?doid=1699571.1699582
  2. 2.
    Augenstein, I., Rocktäschel, T., Vlachos, A., Bontcheva, K.: Stance detection with bidirectional conditional encoding. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 876–885. Association for Computational Linguistics, Austin, November 2016. https://aclweb.org/anthology/D16-1084
  3. 3.
    Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv:1409.0473 [cs, stat], September 2014
  4. 4.
    Blanco, R., Ottaviano, G., Meij, E.: Fast and space-efficient entity linking for queries. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, WSDM 2015, pp. 179–188. ACM Press, Shanghai (2015)  https://doi.org/10.1145/2684822.2685317, http://dl.acm.org/citation.cfm?doid=2684822.2685317
  5. 5.
    Bunescu, R., Pasca, M.: Using encyclopedic knowledge for named entity disambiguation, p. 8 (2006)Google Scholar
  6. 6.
    Chang, A.X., Spitkovsky, V.I., Manning, C.D., Agirre, E.: A comparison of named-entity disambiguation and word sense disambiguation, p. 8 (2016)Google Scholar
  7. 7.
    Cucerzan, S.: Large-scale named entity disambiguation based on Wikipedia data, p. 9 (2007)Google Scholar
  8. 8.
    Dietz, L., Kotov, A., Meij, E.: Utilizing knowledge graphs in text-centric information retrieval. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, WSDM 2017, pp. 815–816. ACM, New York (2017).  https://doi.org/10.1145/3018661.3022756
  9. 9.
    Dorssers, F., de Vries, A.P., Alink, W.: Ranking triples using entity links in a large web crawl. In: Triple Scorer Task at WSDM Cup 2017, p. 5 (2017)Google Scholar
  10. 10.
    Ferragina, P., Scaiella, U.: TAGME: on-the-fly annotation of short text fragments (by Wikipedia entities), p. 1625. ACM Press (2010).  https://doi.org/10.1145/1871437.1871689, http://portal.acm.org/citation.cfm?doid=1871437.1871689
  11. 11.
    Globerson, A., Lazic, N., Chakrabarti, S., Subramanya, A., Ringaard, M., Pereira, F.: Collective entity resolution with multi-focal attention. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Long Papers), vol. 1, pp. 621–631. Association for Computational Linguistics, Berlin, August 2016. http://www.aclweb.org/anthology/P16-1059
  12. 12.
    Hoffart, J., et al.: Robust disambiguation of named entities in text, p. 11 (2011)Google Scholar
  13. 13.
    Khalid, M.A., Jijkoun, V., de Rijke, M.: The impact of named entity normalization on information retrieval for question answering. In: Macdonald, C., Ounis, I., Plachouras, V., Ruthven, I., White, R.W. (eds.) ECIR 2008. LNCS, vol. 4956, pp. 705–710. Springer, Heidelberg (2008).  https://doi.org/10.1007/978-3-540-78646-7_83. http://dl.acm.org/citation.cfm?id=1793274.1793371CrossRefGoogle Scholar
  14. 14.
    Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: ICLR 2017 (2017). http://arxiv.org/abs/1609.02907
  15. 15.
    Meij, E., Balog, K., Odijk, D.: Entity linking and retrieval for semantic search. In: Proceedings of the Seventh ACM International Conference on Web Search and Data Mining, WSDM 2014, pp. 683–684, February 2014Google Scholar
  16. 16.
    Milne, D., Witten, I.H.: Learning to link with Wikipedia, p. 509. ACM Press (2008).  https://doi.org/10.1145/1458082.1458150, http://portal.acm.org/citation.cfm?doid=1458082.1458150
  17. 17.
    Raiman, J., Raiman, O.: DeepType: multilingual entity linking by neural type system evolution. arXiv:1802.01021 [cs], February 2018
  18. 18.
    Ren, X., et al.: CoType: joint extraction of typed entities and relations with knowledge bases, pp. 1015–1024. ACM Press (2017).  https://doi.org/10.1145/3038912.3052708, http://dl.acm.org/citation.cfm?doid=3038912.3052708
  19. 19.
    Usbeck, R., et al.: AGDISTIS - graph-based disambiguation of named entities using linked data. In: Mika, P., et al. (eds.) ISWC 2014. LNCS, vol. 8796, pp. 457–471. Springer, Cham (2014).  https://doi.org/10.1007/978-3-319-11964-9_29CrossRefGoogle Scholar
  20. 20.
    Vaswani, A., et al.: Attention is all you need. In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems, vol. 30, pp. 5998–6008. Curran Associates, Inc. (2017). http://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf
  21. 21.
    Vrandečić, D.: Wikidata: a new platform for collaborative data collection. In: Proceedings of the 21st International Conference on World Wide Web, WWW 2012 Companion, pp. 1063–1064. ACM, New York (2012).  https://doi.org/10.1145/2187980.2188242

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Alberto Cetoli
    • 1
    Email author
  • Stefano Bragaglia
    • 1
  • Andrew D. O’Harney
    • 1
  • Marc Sloan
    • 1
  • Mohammad Akbari
    • 2
  1. 1.ContextscoutLondonUK
  2. 2.UCLLondonUK

Personalised recommendations