Andrea Galassi, Federico Ruggeri, Alberto Barrón-Cedeño, Firoj Alam, Tommaso Caselli, Mucahid Kutlu, Julia Maria Struß, Francesco Antici, Maram Hasanain, Juliane Köhler, Katerina Korre, Folkert Leistra, Arianna Muti, Melanie Siegel, Mehmet Deniz Türkmen, Michael Wiegand, Wajdi Zaghouani
- We describe the outcome of the 2023 edition of the CheckThat!Lab at CLEF. We focus on subjectivity (Task 2), which has been proposed for the first time. It aims at fostering the technology for the identification of subjective text fragments in news articles. For that, we produced corpora consisting of 9,530 manually-annotated sentences, covering six languages - Arabic, Dutch, English, German, Italian, and Turkish. Task 2 attracted 12 teams, which submitted a total of 40 final runs covering all languages. The most successful approaches addressed the task using state-of-the-art multilingual transformer models, which were fine-tuned on language-specific data. Teams also experimented with a rich set of other neural architectures, including foundation models, zero-shot classifiers, and standard transformers, mainly coupled with data augmentation and multilingual training strategies to address class imbalance. We publicly release all the datasets and evaluation scripts, with the purpose of promoting further research on this topic.
MetadatenVerfasserangaben: | Andrea Galassi, Federico Ruggeri, Alberto Barrón-Cedeño, Firoj Alam, Tommaso Caselli, Mucahid Kutlu, Julia Maria StrußORCiDGND, Francesco Antici, Maram Hasanain, Juliane KöhlerORCiDGND, Katerina Korre, Folkert Leistra, Arianna Muti, Melanie Siegel, Mehmet Deniz Türkmen, Michael Wiegand, Wajdi Zaghouani |
---|
URL: | https://ceur-ws.org/Vol-3497/paper-020.pdf |
---|
Titel des übergeordneten Werkes (Englisch): | CLEF 2023 Working Notes |
---|
Untertitel (Englisch): | Notebook for the CheckThat! Lab at CLEF 2023 |
---|
Verlagsort: | Thessaloniki |
---|
Herausgeber*in: | Mohammad Aliannejadi, Guglielmo Faggiolo, Nicola Ferro, Michalis Vlachos |
---|
Dokumentart: | Konferenzveröffentlichung |
---|
Sprache: | Englisch |
---|
Jahr der Erstveröffentlichung: | 2023 |
---|
Veröffentlichende Institution: | Fachhochschule Potsdam |
---|
Urhebende Körperschaft: | Centre for Research and Technology Hellas |
---|
Datum der Freischaltung: | 13.12.2023 |
---|
GND-Schlagwort: | Desinformation; Fehlinformation; COVID-19 |
---|
Erste Seite: | 236 |
---|
Letzte Seite: | 249 |
---|
Fachbereiche und Zentrale Einrichtungen: | FB5 Informationswissenschaften |
---|
| FB5 Informationswissenschaften / Publikationen des FB Informationswissenschaften |
---|
DDC-Klassifikation: | 000 Informatik, Informationswissenschaft, allgemeine Werke / 020 Bibliotheks- und Informationswissenschaften |
---|
Lizenz (Deutsch): | Creative Commons - CC BY - Namensnennung 4.0 International |
---|