Shared task evaluation campaigns represent a well established form of competitive evaluation, an important opportunity to propose and tackle new challenges for a specific research area and a way to foster the development of benchmarks, tools and resources. The advantages of this approach are evident in any experimental field, including the area of Natural Language Processing. An outlook on state–of–the–art language technologies for Italian can be obtained by reflecting on the results of the recently held workshop “Evaluation of NLP and Speech Tools for Italian”, EVALITA 2014. The motivations underlying individual shared tasks, the level of knowledge and development achieved within each of them, the impact on applications, society and economy at large as well as directions for future research will be discussed from this perspective.

State of the Art Language Technologies for Italian: The EVALITA 2014 Perspective

Basile, Valerio;BOSCO, CRISTINA;PATTI, Viviana;
2015-01-01

Abstract

Shared task evaluation campaigns represent a well established form of competitive evaluation, an important opportunity to propose and tackle new challenges for a specific research area and a way to foster the development of benchmarks, tools and resources. The advantages of this approach are evident in any experimental field, including the area of Natural Language Processing. An outlook on state–of–the–art language technologies for Italian can be obtained by reflecting on the results of the recently held workshop “Evaluation of NLP and Speech Tools for Italian”, EVALITA 2014. The motivations underlying individual shared tasks, the level of knowledge and development achieved within each of them, the impact on applications, society and economy at large as well as directions for future research will be discussed from this perspective.
2015
9
1
43
61
http://content.iospress.com/articles/intelligenza-artificiale/ia076
Evaluation Campaign, Natural Language Processing, Dependency Parsing, Sentiment Analysis, Temporal Processing
Attardi, Giuseppe; Basile, Valerio; Bosco, Cristina; Caselli, Tommaso; Dell'Orletta, Felice; Montemagni, Simonetta; Patti, Viviana; Simi, Maria; Sprugnoli, Rachele
File in questo prodotto:
File Dimensione Formato  
IA076-1.pdf

Accesso aperto

Tipo di file: POSTPRINT (VERSIONE FINALE DELL’AUTORE)
Dimensione 343.28 kB
Formato Adobe PDF
343.28 kB Adobe PDF Visualizza/Apri
ia%2F2015%2F9-1%2Fia-9-1-ia076%2Fia-9-1-ia076.pdf

Accesso riservato

Tipo di file: PDF EDITORIALE
Dimensione 339.59 kB
Formato Adobe PDF
339.59 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/1521599
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? 5
social impact