Abstract
The aim of the EVALITA Parsing Task (EPT) is at defining and extending Italian state-of-the-art parsing by encouraging the application of existing models and approaches, comparing paradigms and annotation formats. Therefore, in all the editions, held respectively in 2007, 2009 and 2011, the Task has been organized around two tracks, namely Dependency Parsing and Constituency Parsing, exploiting the same data sets made available by the organizers in two different formats.
This paper describes the Dependency Parsing Task assuming an historical perspective, but mainly focussing on the last edition held in 2011. It presents and compares the resources exploited for development and testing, the participant systems and the results, showing also the improvement of resources and scores during the three editions of this contest.
This work has been partially funded by the PARLI Project (Portale per l’Accesso alle Risorse Linguistiche per l’Italiano MIUR PRIN 2008).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Attardi, G., Simi, M.: DeSR at the Evalita Dependency Parsing Task. Intelligenza Artificiale 2(IV), 40–41 (2007)
Bos, J., Bosco, C., Mazzei, A.: Converting a dependency treebank to a Categorial Grammar treebank for Italian. In: Proceedings of the Eighth Workshop on Treebanks and Linguistic Theories (TLT 2008), Milan, Italy, pp. 27–38 (2009)
Bosco, C.: A grammatical relation system for treebank annotation. Ph.D. thesis, University of Turin (2004)
Bosco, C.: Multiple-step treebank conversion: from dependency to Penn format. In: Proceedings of the Linguistic Annotation Workshop (LAW) 2007, Prague, Czech Republic, pp. 164–167 (2007)
Bosco, C., Lavelli, A.: Annotation schema oriented validation for dependency parsing evaluation. In: Proceedings of the Ninth Workshop on Treebanks and Linguistic Theories (TLT 2009), Tartu, Estonia, pp. 19–30 (2010)
Bosco, C., Lombardo, V., Vassallo, D., Lesmo, L.: Building a treebank for Italian: a data-driven annotation schema. In: Proceedings of second International Conference on Language Resources and Evaluation (LREC 2000), Athens, Greece (2000)
Bosco, C., Mazzei, A., Lavelli, A.: Looking back to the EVALITA Constituency Parsing Task: 2007-2011. In: Magnini, B., Cutugno, F., Falcone, M., Pianta, E. (eds.) EVALITA 2012. LNCS(LNAI), vol. 7689, pp. 46–57. Springer, Heidelberg (2012)
Bosco, C., Mazzei, A., Lombardo, V.: Evalita Parsing Task: an analysis of the first parsing system contest for Italian. Intelligenza Artificiale 2(IV), 30–33 (2007)
Bosco, C., Mazzei, A., Lombardo, V.: Evalita 2009 Parsing Task: constituency parsers and the Penn format for Italian. In: Proceedings of Evalita 2009, Reggio Emilia, Italy (2009)
Bosco, C., Montemagni, S., Mazzei, A., Lombardo, V., Dell’Orletta, F., Lenci, A.: Evalita 2009 Parsing Task: comparing dependency parsers and treebanks. In: Proceedings of Evalita 2009, Reggio Emilia, Italy (2009)
Bosco, C., Montemagni, S., Mazzei, A., Lombardo, V., Dell’Orletta, F., Lenci, A., Lesmo, L., Attardi, G., Simi, M., Lavelli, A., Hall, J., Nilsson, J., Nivre, J.: Comparing the influence of different treebank annotations on dependency parsing. In: Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC 2010), La Valletta, Malta, pp. 1794–1801 (2010)
Bosco, C., Mazzei, A., Lombardo, V., Attardi, G., Corazza, A., Lavelli, A., Lesmo, L., Satta, G., Simi, M.: Comparing Italian parsers on a common treebank: the EVALITA experience. In: Proceedings of the Sixth International Conference on Language Resources and Evaluation, Marrakech, Morocco, pp. 2066–2073 (2008)
Bucholz, S., Marsi, E.: CoNLL-X Shared Task on multilingual dependency parsing. In: Proceedings of the CoNLL-X, New York, USA, pp. 149–164 (2007)
Grella, M., Nicola, M., Christen, D.: Experiments with a constraint-based dependency parser. In: Evalita 2011 Working Notes (2012)
Hudson, R.: Word grammar. Basil Blackwell, Oxford (1984)
Kübler, S., McDonald, R., Nivre, J.: Dependency parsing. Morgan and Claypool Publishers (2009)
Montemagni, S., Barsotti, F., Battista, M., Calzolari, N., Corazzari, O., Lenci, A., Zampolli, A., Fanciulli, F., Massetani, M., Raffaelli, R., Basili, R., Pazienza, M.T., Saracino, D., Zanzotto, F., Mana, N., Pianesi, F., Delmonte, R.: Building the Italian Syntactic-Semantic Treebank. In: Abeillé, A. (ed.) Building and Using Syntactically Annotated Corpora, pp. 189–210. Kluwer, Dordrecht (2003)
Nivre, J., Hall, J., Kübler, S., McDonald, R., Nilsson, J., Riedel, S., Yuret, D.: The CoNLL 2007 Shared Task on dependency parsing. In: Proceedings of the EMNLP-CoNLL, Prague, Czech Republic, pp. 915–932 (2007)
Nivre, J., Hall, J.H., Chanev, A.: MaltParser: a language-independent system for data-driven dependency parsing. Natural Language Engineering 13(2), 95–135 (2007)
Testa, M., Bolioli, A., Dini, L., Mazzini, G.: Evaluation of a semantically oriented dependency grammar for Italian at EVALITA. In: Proceedings of Evalita 2009, Reggio Emilia, Italy (2009)
Tonelli, S., Delmonte, R., Bristot, A.: Enriching the Venice Italian Treebank with dependency and grammatical relations. In: Proceedings of the sixth International Conference on Language Resources and Evaluation (LREC 2008), Marrakech, Morocco, pp. 1920–1924 (2008)
Zanzotto, F.M.: Lost in grammar translation. Intelligenza Artificiale 2(IV), 42–43 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bosco, C., Mazzei, A. (2013). The EVALITA Dependency Parsing Task: From 2007 to 2011. In: Magnini, B., Cutugno, F., Falcone, M., Pianta, E. (eds) Evaluation of Natural Language and Speech Tools for Italian. EVALITA 2012. Lecture Notes in Computer Science(), vol 7689. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35828-9_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-35828-9_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35827-2
Online ISBN: 978-3-642-35828-9
eBook Packages: Computer ScienceComputer Science (R0)