Skip to main content
SpringerLink
Log in

Challenges of an Annotation Task for Open Information Extraction in Portuguese

  • Conference paper
  • First Online:
Computational Processing of the Portuguese Language (PROPOR 2018)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11122))

Abstract

Open information extraction (Open IE) is a task of extracting facts from a plain text without limiting the analysis to a predefined set of relationships. Although a significant number of studies have focused on this problem in the last years, there is a lack of available linguistic resources for languages other than English. An essential resource for the evaluation of Open IE methods is notably an annotated corpus. In this work, we present the challenges involved in the creation of a golden set corpus for the Open IE task in the Portuguese language. We describe our methodology, an annotation tool to support the task and our results on performing this annotation task in a small validation corpus.

Supported by CAPES process grant number 1573345.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Queries was performed on March 2018.

  2. 2.

    http://scholar.google.com Query 1: 172 entries and Query 2: 35 entries.

  3. 3.

    https://dblp.uni-trier.de Query 1: 2 entries and Query 2: no matches.

  4. 4.

    Download at http://gramatica.usc.es/~gamallo/prototypes/ArgOE-beta.tar.gz.

  5. 5.

    Download at https://console.cloud.google.com/storage/browser/wikipedia_multilingual_relations_v1/multilingual_relations_data/auto/extractions/.

  6. 6.

    Download at http://formas.ufba.br/page/downloads.

  7. 7.

    http://www.linguateca.pt/cetenfolha/.

  8. 8.

    http://brat.nlplab.org/.

  9. 9.

    https://stanfordnlp.github.io/CoreNLP/.

  10. 10.

    http://cogroo.sourceforge.net/download/current.html.

  11. 11.

    https://dkpro.github.io/dkpro-statistics/.

  12. 12.

    http://universaldependencies.org/.

  13. 13.

    The Brazilian Portuguese Universal Dependencies is converted from the Google Universal Dependency Treebanks version 2.0.

  14. 14.

    http://formas.ufba.br/.

  15. 15.

    https://dkpro.github.io/dkpro-statistics/dkpro-agreement-tutorial.pdf.

References

  1. de Abreu, S.C., Vieira, R.: Relp: Portuguese open relation extraction. Knowl. Org. 44(3), 163–177 (2017)

    Article  Google Scholar 

  2. Akbik, A., Löser, A.: Kraken: N-ary facts in open information extraction. In: Proceedings of AKBC-WEKEX, pp. 52–56. ACL (2012)

    Google Scholar 

  3. Artstein, R., Poesio, M.: Inter-coder agreement for computational linguistics. Comput. Linguist. 34(4), 555–596 (2008)

    Article  Google Scholar 

  4. Banko, M., Cafarella, M.J., Soderland, S., Broadhead, M., Etzioni, O.: Open information extraction from the web. Proc. IJCAI 7, 2670–2676 (2007)

    Google Scholar 

  5. Barbosa, G., Claro, D.B.: Utilizando features linguísticas genéricas para classificação de triplas relacionais em português (generic linguistic features for relational triples classification in portuguese)[in portuguese]. In: Proceedings of STIL, pp. 132–141 (2017)

    Google Scholar 

  6. Collovini, S., Machado, G., Vieira, R.: Extracting and Structuring Open Relations from Portuguese Text. In: Silva, J., Ribeiro, R., Quaresma, P., Adami, A., Branco, A. (eds.) PROPOR 2016. LNCS (LNAI), vol. 9727, pp. 153–164. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-41552-9_16

    Chapter  Google Scholar 

  7. Collovini, S., Pugens, L., Vanin, A.A., Vieira, R.: Extraction of relation descriptors for Portuguese using conditional random fields. In: Bazzan, A.L.C., Pichara, K. (eds.) IBERAMIA 2014. LNCS (LNAI), vol. 8864, pp. 108–119. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-12027-0_9

    Chapter  Google Scholar 

  8. Eugenio, B.D., Glass, M.: The kappa statistic: a second look. Comput. Linguist. 30(1), 95–101 (2004)

    Article  Google Scholar 

  9. Faruqui, M., Kumar, S.: Multilingual open relation extraction using cross-lingual projection. In: Proceedings of NAACL HLT, pp. 1351–1356 (2015)

    Google Scholar 

  10. Franco, W., Pinheiro, V., Pequeno, M., Furtado, V.: Aquisição de relações semânticas a partir de textos da wikipédia. In: Proceedings of ENIAC, p. 52. Unifor (2013)

    Google Scholar 

  11. Gamallo, P., Garcia, M.: Multilingual open information extraction. In: Pereira, F., Machado, P., Costa, E., Cardoso, A. (eds.) EPIA 2015. LNCS (LNAI), vol. 9273, pp. 711–722. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-23485-4_72

    Chapter  Google Scholar 

  12. Gamallo, P., Garcia, M.: Linguakit: uma ferramenta multilingue para a análise linguística e a extração de informação. Linguamática 9(1), 19–28 (2017)

    Article  Google Scholar 

  13. Gamallo, P., Garcia, M., Fernández-Lanza, S.: Dependency-based open information extraction. In: Proceedings of the Joint Workshop on Unsupervised and Semi-Supervised Learning in NLP, pp. 10–18. ROBUS-UNSUP ’12, ACL (2012)

    Google Scholar 

  14. Garcia, M., Gamallo, P.: Entity-centric coreference resolution of person entities for open information extraction. Procesamiento del Lenguaje Natural 53, 25–32 (2014)

    Google Scholar 

  15. Glauber, R., Claro, D.B.: A systematic mapping study on open information extraction. Expert Systems with Applications (2018). https://doi.org/10.1016/j.eswa.2018.06.046, http://www.sciencedirect.com/science/article/pii/S0957417418303932

    Article  Google Scholar 

  16. Hovy, E., Lavid, J.: Towards a ‘science’ of corpus annotation: a new methodological challenge for corpus linguistics. Int. J. Transl. 22(1), 13–36 (2010)

    Google Scholar 

  17. Mioto, C., Silva, M.C.F., Lopes, R.E.V.: Novo manual de sintaxe. Insular (2005). https://books.google.com.br/books?id=GPCpSAAACAAJ

  18. de Oliveira, L.S., Glauber, R., Claro, D.B.: Dependentie: an open information extraction system on Portuguese by a dependence analysis. In: Proceedings of ENIAC, pp. 271–282. FC-UFU (2017)

    Google Scholar 

  19. Passonneau, R., Habash, N., Rambow, O.: Inter-annotator agreement on a multilingual semantic annotation task. In: Proceedings of LREC, pp. 1951–1956 (2006)

    Google Scholar 

  20. Pereira, V., Pinheiro, V.: Report-um sistema de extração de informações aberta para língua portuguesa (report-an open information extraction system for portuguese language). In: Proceedings of STIL, pp. 191–200 (2015)

    Google Scholar 

  21. Petersen, K., Vakkalanka, S., Kuzniarz, L.: Guidelines for conducting systematic mapping studies in software engineering: an update. Inf. Softw. Technol. 64, 1–18 (2015)

    Article  Google Scholar 

  22. Randolph, J.J.: Free-marginal multirater kappa (multirater k [free]): an alternative to fleiss’ fixed-marginal multirater kappa. Online submission (2005)

    Google Scholar 

  23. Rodrigues, R., Gomes, P.: Improving question-answering for Portuguese using triples extracted from corpora. In: Silva, J., Ribeiro, R., Quaresma, P., Adami, A., Branco, A. (eds.) PROPOR 2016. LNCS (LNAI), vol. 9727, pp. 25–37. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-41552-9_3

    Chapter  Google Scholar 

  24. Schmitz, M., Bart, R., Soderland, S., Etzioni, O., et al.: Open language learning for information extraction. In: Proceedings of EMNLP, pp. 523–534. ACL (2012)

    Google Scholar 

  25. Sena, C.F.L., Glauber, R., Claro, D.B.: Inference approach to enhance a Portuguese open information extraction. In: Proceedings of the 19th International Conference on Enterprise Information Systems ICEIS, vol. 1, pp. 442–451. INSTICC, ScitePress (2017)

    Google Scholar 

  26. Souza, E.N.P., Claro, D.B.: Extração de relações utilizando features diferenciadas para português. Linguamática 6(2), 57–65 (2014)

    Google Scholar 

  27. Souza, E.N.P., Claro, D.B., Glauber, R.: A similarity grammatical structures based method for improving open information systems. J. Univers. Comput. Sci. 24(1), 43–69 (2018)

    MathSciNet  Google Scholar 

  28. Wu, F., Weld, D.S.: Open information extraction using wikipedia. In: Proceedings of Annual Meeting of the Association for Computational Linguistics, pp. 118–127. ACL (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Formalisms and Semantic Applications Research Group (FORMAS) LASiD/DCC/IME, Federal University of Bahia, Salvador, Bahia, Brazil

    Rafael Glauber, Leandro Souza de Oliveira, Cleiton Fernando Lima Sena, Daniela Barreiro Claro & Marlo Souza

Authors
  1. Rafael Glauber
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Leandro Souza de Oliveira
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Cleiton Fernando Lima Sena
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Daniela Barreiro Claro
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Marlo Souza
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniela Barreiro Claro .

Editor information

Editors and Affiliations

  1. Institute of Informatics, Federal University of Rio Grande do Sul, Porto Alegre, Brazil

    Aline Villavicencio

  2. Instituto de Informática - UFRGS, Porto Alegre, Brazil

    Viviane Moreira

  3. INESC-ID, Lisbon, Portugal

    Alberto Abad

  4. UFSCAR, Sao Carlos, Brazil

    Helena Caseli

  5. Centro Singular de Investigación en Tecnoloxías, Universidade de Santiago de Compostela, Santiago de Compostela, La Coruña, Spain

    Pablo Gamallo

  6. Université de Toulon, Parc Scientifique Technologique Luminy, Marseille, France

    Carlos Ramisch

  7. Centro de Informática e Sistemas, Universidade de Coimbra, Coimbra, Portugal

    Hugo Gonçalo Oliveira

  8. Federal University of Technology, Dois Vizinhos, Paraná, Brazil

    Gustavo Henrique Paetzold

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Glauber, R., de Oliveira, L.S., Sena, C.F.L., Claro, D.B., Souza, M. (2018). Challenges of an Annotation Task for Open Information Extraction in Portuguese. In: Villavicencio, A., et al. Computational Processing of the Portuguese Language. PROPOR 2018. Lecture Notes in Computer Science(), vol 11122. Springer, Cham. https://doi.org/10.1007/978-3-319-99722-3_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-99722-3_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-99721-6

  • Online ISBN: 978-3-319-99722-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation