1. Overview of the SPMRL 2013 Shared Task: A Cross-Framework Evaluation of Parsing Morphologically Rich Languages
- Author
-
Seddah, Djamé, Tsarfaty, Reut, Kübler, Sandra, Candito, Marie, Choi, Jinho D., Farkas, Richárd, Foster, Jennifer, Goenaga, Iakes, Gojenola Galletebeitia, Koldo, Goldberg, Yoav, Green, Spence, Habash, Nizar, Kuhlmann, Marco, Maier, Wolfgang, Nivre, Joakim, Przepiórkowski, Adam, Roth, Ryan, Seeker, Wolfgang, Versley, Yannick, Vincze, Veronika, Wolińsk, Marcin, Wróblewska, Alina, Villemonte de La Clergerie, Éric, Analyse Linguistique Profonde à Grande Echelle, Large-scale deep linguistic processing (ALPAGE), Inria Paris-Rocquencourt, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Université Paris Diderot - Paris 7 (UPD7), Faculty of Mathematics and Computer Science, Weizmann Institute of Science [Rehovot, Israël], Computational Linguistics, Department of Linguistics (DL), Indiana University [Bloomington], Indiana University System-Indiana University System-Indiana University [Bloomington], Indiana University System-Indiana University System, IPSOFT (Ipsoft), University of Massachusetts [Amherst] (UMass Amherst), University of Massachusetts System (UMASS)-University of Massachusetts System (UMASS), Department of Computer Algorithms and Artificial Intelligence., University of Szeged [Szeged], National Centre for Language Technology (NCLT), Dublin City University [Dublin] (DCU), Computer Languages and Systems, University of the Basque Country [Bizkaia] (UPV/EHU), Department of Computer Science, Bar-Ilan University [Israël], Stanford NLP Group, Stanford University, Center for Computational Learning Systems (CCLS), Columbia University [New York], Computational Linguistics and Language Technology, Uppsala University, Abteilung für Computerlinguistik [Düsseldorf ], Philosophische Fakultät [Düsseldorf], Heinrich Heine Universität Düsseldorf = Heinrich Heine University [Düsseldorf]-Heinrich Heine Universität Düsseldorf = Heinrich Heine University [Düsseldorf]-Instituts für Sprache und Information [Düsseldorf], Heinrich Heine Universität Düsseldorf = Heinrich Heine University [Düsseldorf], Institute of Computer Science [Warszawa], Polska Akademia Nauk = Polish Academy of Sciences (PAN), Institut für Maschinelle Sprachverarbeitung, Universität Stuttgart [Stuttgart], Institute for Computational Linguistics, Universität Heidelberg [Heidelberg], Université Paris Diderot - Paris 7 (UPD7)-Inria Paris-Rocquencourt, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), University of the Basque Country/Euskal Herriko Unibertsitatea (UPV/EHU), and Universität Heidelberg [Heidelberg] = Heidelberg University
- Subjects
langues à morphologie riche ,evaluation ,parsing en dépendance ,Statistical Parsing ,Morphologically-rich languages ,parsing en constituents ,non gold scenarios ,Parsing statistiques ,[INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL] ,dependency parsing ,TheoryofComputation_MATHEMATICALLOGICANDFORMALLANGUAGES ,analyse syntaxique à large couverture ,phrase based parsing ,treebanking ,[SHS.LANGUE]Humanities and Social Sciences/Linguistics ,non gold tokenization - Abstract
International audience; This paper reports on the first shared task on statistical parsing of morphologically rich lan- guages (MRLs). The task features data sets from nine languages, each available both in constituency and dependency annotation. We report on the preparation of the data sets, on the proposed parsing scenarios, and on the eval- uation metrics for parsing MRLs given dif- ferent representation types. We present and analyze parsing results obtained by the task participants, and then provide an analysis and comparison of the parsers across languages and frameworks, reported for gold input as well as more realistic parsing scenarios.
- Published
- 2013