[PlanetKR] 2nd Call for Participation: DisCoTEX @ EVALITA 2023

[daniele radicioni]

[Apologies for cross-posting]
***************************
Second Call for Participation
****************************

TASK: Assessing DIScourse COherence in Italian TEXts (DisCoTEX) @ EVALITA 2023 
Info: https://sites.google.com/view/discotex/home
Final Workshop: September 7th-8th, 2023, Parma, Italy


We invite interested parties from academia and industry to participate in the DisCoTEX Task, which will be held in the context of Evalita 2023 <https://www.evalita.it/campaigns/evalita-2023/>. 

DisCoTEX is the first shared task focused on modeling discourse coherence for Italian real-word texts. Coherence is a key property of any well-organized text and it plays a fundamental role in human discourse processing as well as in a number of NLP applications. Inspired by previous literature on coherence modeling, the DisCoTEX task will be articulated into two subtasks:

1. Last sentence classification: this is conceived as a binary classification task. Specifically, given a short textual passage and an individual sentence, participants will be asked to predict whether the sentence follows or not, thus joining it to the passage gives out a coherent or incoherent passage. 
2. Human score prediction: this is conceived as a regression task in which participants will be asked to predict the average coherence score assigned by human raters to short passages (either in their original or modified version). 
Participants are free to participate in either one of them or both. 

More details about the task definition, source data and evaluation are available at the task website <https://sites.google.com/view/discotex/home>.


Given the novelty of the task and the crucial role that coherence modeling plays in a variety of application scenarios, we expect to attract groups from communities working on distinct fields, such as automatic essay scoring, readability assessment and document summarization. Moreover, we hope that beyond the competition, the task would rise the interest of scholars working on theoretical models of coherence from a linguistic and a cognitive perspective, as well as those involved in the interpretability of current language models based on deep learning networks. 
-----------------------

Important Dates
-----------------------
7th February 2023: training data available to participants
2nd – 9 May 2023: test data available (evaluation window starts)
30th May 2023: results notification to participants
14th June 2023: technical report from participants due to task organizers
28th June 2023: final reports from task organizers due to EVALITA chairs
10th July 2023: review deadline
25th July 2023: camera ready version deadline
7th-8th September 2023: EVALITA workshop in Parma

Updates will be made available at the Evalita 2023 website, check it often.

----------------
Organizers
----------------
Dominique Brunato*
Davide Colla**
Felice Dell'Orletta*
Irene Dini*
Daniele Paolo Radicioni**
Andrea Amelio Ravelli***

* ItaliaNLP Lab, Istituto di Linguistica Computazionale "Antonio Zampolli" (ILC-CNR), Pisa
** Dipartimento di Informatica, Università degli Studi di Torino
*** Università di Bologna, Bologna

----------------------------------------------------------------
Contacts: discotex.evalita2023 at gmail.com <mailto:discotex.evalita2023 at gmail.com>
----------------------------------------------------------------

Feel free to contact us for further information!

The DisCoTEX organizing committee 





: : : : : : : : : : : : : : : : : : :

Daniele Radicioni, PhD
Department of Computer Science
University of Turin
Corso Svizzera, 185
10149 - Torino
phone: +39 011 6706802
fax:   +39 011 751603
http://www.di.unito.it/~radicion




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://kr.org/pipermail/planetkr/attachments/20230418/24f31320/attachment.htm>