Skip to main content

CzEng 1.6: Enlarged Czech-English Parallel Corpus with Processing Tools Dockered

  • Conference paper
  • First Online:
Text, Speech, and Dialogue (TSD 2016)

Abstract

We present a new release of the Czech-English parallel corpus CzEng. CzEng 1.6 consists of about 0.5 billion words (“gigaword”) in each language. The corpus is equipped with automatic annotation at a deep syntactic level of representation and alternatively in Universal Dependencies. Additionally, we release the complete annotation pipeline as a virtual machine in the Docker virtualization toolkit.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.statmt.org/wmt10 through http://www.statmt.org/wmt15.

  2. 2.

    https://ec.europa.eu/jrc/en/language-technologies/dgt-acquis.

  3. 3.

    http://eur-lex.europa.eu/.

  4. 4.

    http://eur-lex.europa.eu/browse/summaries.html.

  5. 5.

    http://www.opensubtitles.org/.

  6. 6.

    http://opus.lingfil.uu.se/OpenSubtitles2016.php.

  7. 7.

    http://www.khanacademy.org/ and http://www.khanovaskola.cz/.

  8. 8.

    http://www.ted.com/.

  9. 9.

    http://www.ema.europa.eu/.

  10. 10.

    http://opus.lingfil.uu.se/EMEA.php.

  11. 11.

    http://ufal.mff.cuni.cz/treex, a web demo is available at http://lindat.mff.cuni.cz/services/treex-web/run.

  12. 12.

    https://metacpan.org/release/Treex-Core.

  13. 13.

    https://www.docker.com/.

  14. 14.

    https://hub.docker.com/r/ufal/treex/.

  15. 15.

    https://hub.docker.com/r/ufal/czeng16/.

  16. 16.

    https://github.com/ufal/treex.

  17. 17.

    http://ufal.mff.cuni.cz/tred.

  18. 18.

    http://universaldependencies.org/.

  19. 19.

    http://udapi.github.io/.

References

  1. Bojar, O., Žabokrtský, Z., Dušek, O., Galuščáková, P., Majliš, M., Mareček, D., Maršík, J., Novák, M., Popel, M., Tamchyna, A.: The joy of parallelism with CzEng 1.0. In: LREC, Istanbul, Turkey, pp. 3921–3928 (2012)

    Google Scholar 

  2. Callison-Burch, C., Koehn, P., Monz, C., Peterson, K., Przybocki, M., Zaidan, O.: Findings of the 2010 joint workshop on statistical machine translation and metrics for machine translation. In: Joint WMT and MetricsMATR, pp. 17–53 (2010)

    Google Scholar 

  3. Bojar, O., Chatterjee, R., Federmann, C., Haddow, B., Huck, M., Hokamp, C., Koehn, P., Logacheva, V., Monz, C., Negri, M., Post, M., Scarton, C., Specia, L., Turchi, M.: Findings of the 2015 workshop on statistical machine translation. In: WMT, Lisboa, Portugal, pp. 1–46 (2015)

    Google Scholar 

  4. Tiedemann, J.: News from OPUS - a collection of multilingual parallel corpora with tools and interfaces. In: RANLP, pp. 237–248 (2009)

    Google Scholar 

  5. Esplà-Gomis, M., Forcada, M.L.: Combining Content-based and URL-Based Heuristics to Harvest Aligned Bitexts from Multilingual Sites With Bitextor. Prague Bulletin of Mathematical Linguistics, vol. 93. Charles University (2010)

    Google Scholar 

  6. Popel, M., Žabokrtský, Z.: TectoMT: modular NLP framework. In: Loftsson, H., Rögnvaldsson, E., Helgadóttir, S. (eds.) IceTAL 2010. LNCS, vol. 6233, pp. 293–304. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  7. Sgall, P., Hajičová, E., Panevová, J.: The Meaning of the Sentence and Its Semantic and Pragmatic Aspects. Academia/Reidel Publishing Company, Prague (1986)

    Google Scholar 

  8. McDonald, R., Pereira, F., Ribarov, K., Hajič, J.: Non-projective dependency parsing using spanning tree algorithms. In: HLT/EMNLP, pp. 523–530 (2005)

    Google Scholar 

  9. Straková, J., Straka, M., Hajič, J.: Open-source tools for morphology, lemmatization, POS tagging and named entity recognition. In: Proceedings of ACL: System Demonstrations, Baltimore, Maryland, pp. 13–18. ACL (2014)

    Google Scholar 

  10. Bejček, E., Panevová, J., Popelka, J., Straňák, P., Ševčíková, M., Štěpánek, J., Žabokrtský, Z.: Prague dependency treebank 2.5 a revisited version of PDT 2.0. In: Coling, pp. 231–246 (2012)

    Google Scholar 

  11. Palmer, M., Gildea, D., Kingsbury, P.: The proposition bank: an annotated corpus of semantic roles. Comput. Linguist. 31, 71–106 (2005)

    Article  Google Scholar 

  12. Mareek, D., Duek, O., Rosa, R.: Progress report on translation with deep generation. Project FAUST deliverable D5.5 (2012)

    Google Scholar 

  13. Fan, R.E., Chang, K.W., Hsieh, C.J., Wang, X.R., Lin, C.J.: LIBLINEAR: a library for large linear classification. JMLR 9, 1871–1874 (2008)

    MATH  Google Scholar 

  14. Hajič, J., Hajičová, E., Panevová, J., Sgall, P., Bojar, O., Cinková, S., Fučíková, E., Mikulová, M., Pajas, P., Popelka, J., Semecký, J., Šindlerová, J., Štěpánek, J., Toman, J., Urešová, Z., Žabokrtský, Z.: Announcing Prague Czech-english dependency treebank 2.0. In: LREC, Istanbul, Turkey (2012)

    Google Scholar 

  15. Langford, J., Li, L., Strehl, A.: Vowpal Wabbit online learning project. Technical report (2007)

    Google Scholar 

  16. Dušek, O., Fučíková, E., Hajič, J., Popel, M., Šindlerová, J., Urešová, Z.: Using parallel texts and lexicons for verbal word sense disambiguation. In: Depling, Uppsala, Sweden, pp. 82–90 (2015)

    Google Scholar 

  17. Urešová, Z., Dušek, O., Fučíková, E., Hajič, J., Šindlerová, J.: Bilingual English-Czech valency lexicon linked to a parallel corpus. In: LAW IX, Denver, Colorado, pp. 124–128 (2015)

    Google Scholar 

  18. Versley, Y., Ponzetto, S.P., Poesio, M., Eidelman, V., Jern, A., Smith, J., Yang, X., Moschitti, A.: BART: a modular toolkit for coreference resolution. In: ACL-HLT, pp. 9–12 (2008)

    Google Scholar 

  19. Uryupina, O., Moschitti, A., Poesio, M.: BART goes multilingual: the UniTN/Essex submission to the CoNLL-2012 shared task. In: EMNLP-CoNLL (2012)

    Google Scholar 

  20. Bergsma, S., Yarowsky, D.: NADA: a robust system for non-referential pronoun detection. In: Hendrickx, I., Lalitha Devi, S., Branco, A., Mitkov, R. (eds.) DAARC 2011. LNCS, vol. 7099, pp. 12–23. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  21. Nedoluzhko, A., Novák, M., Cinková, S., Mikulová, M., Mírovský, J.: Coreference in Prague Czech-English dependency treebank. In: LREC (2016)

    Google Scholar 

Download references

Acknowledgement

We would like to thank to Christian Buck for providing us with raw crawled PDFs. This project received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement 645452 (QT21) and 644402 (HimL), and also from FP7-ICT-2013-10-610516 (QTLeap), GA15-10472S (Manyla), GA16-05394S, GAUK 338915, and SVV 260 333. This work has been using language resources and tools developed and/or stored and/or distributed by the LINDAT/CLARIN project of the Ministry of Education, Youth and Sports of the Czech Republic (project LM2015071).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ondřej Bojar .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Bojar, O. et al. (2016). CzEng 1.6: Enlarged Czech-English Parallel Corpus with Processing Tools Dockered. In: Sojka, P., Horák, A., Kopeček, I., Pala, K. (eds) Text, Speech, and Dialogue. TSD 2016. Lecture Notes in Computer Science(), vol 9924. Springer, Cham. https://doi.org/10.1007/978-3-319-45510-5_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-45510-5_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-45509-9

  • Online ISBN: 978-3-319-45510-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics