TY - CHAP A1 - Galassi, Andrea A1 - Ruggeri, Federico A1 - Barrón-Cedeño, Alberto A1 - Alam, Firoj A1 - Caselli, Tommaso A1 - Kutlu, Mucahid A1 - Struß, Julia Maria A1 - Antici, Francesco A1 - Hasanain, Maram A1 - Köhler, Juliane A1 - Korre, Katerina A1 - Leistra, Folkert A1 - Muti, Arianna A1 - Siegel, Melanie A1 - Türkmen, Mehmet Deniz A1 - Wiegand, Michael A1 - Zaghouani, Wajdi ED - Aliannejadi, Mohammad ED - Faggiolo, Guglielmo ED - Ferro, Nicola ED - Vlachos, Michalis T1 - Overview of the CLEF-2023 CheckThat! Lab: Task 2 on Subjectivity in News Articles BT - Notebook for the CheckThat! Lab at CLEF 2023 T2 - CLEF 2023 Working Notes N2 - We describe the outcome of the 2023 edition of the CheckThat!Lab at CLEF. We focus on subjectivity (Task 2), which has been proposed for the first time. It aims at fostering the technology for the identification of subjective text fragments in news articles. For that, we produced corpora consisting of 9,530 manually-annotated sentences, covering six languages - Arabic, Dutch, English, German, Italian, and Turkish. Task 2 attracted 12 teams, which submitted a total of 40 final runs covering all languages. The most successful approaches addressed the task using state-of-the-art multilingual transformer models, which were fine-tuned on language-specific data. Teams also experimented with a rich set of other neural architectures, including foundation models, zero-shot classifiers, and standard transformers, mainly coupled with data augmentation and multilingual training strategies to address class imbalance. We publicly release all the datasets and evaluation scripts, with the purpose of promoting further research on this topic. KW - Desinformation KW - Fehlinformation KW - COVID-19 Y1 - 2023 UR - https://ceur-ws.org/Vol-3497/paper-020.pdf SP - 236 EP - 249 CY - Thessaloniki ER - TY - CHAP A1 - Alam, Firoj A1 - Struß, Julia Maria A1 - Chakraborty, Tanmoy A1 - Dietze, Stefan A1 - Hafid, Salim A1 - Korre, Katerina A1 - Muti, Arianna A1 - Nakov, Preslav A1 - Ruggeri, Federico A1 - Schellhammer, Sebastian A1 - Setty, Vinay A1 - Sundriyal, Megha A1 - Todorov, Konstantin A1 - Venktesh, V. ED - Hauff, Claudia ED - Macdonald, Craig ED - Jannach, Dietmar ED - Nardini, Franco Maria ED - Pinelli, Fabio ED - Silvestri, Fabrizio ED - Tonellotto, Nicola T1 - The CLEF-2025 CheckThat! Lab BT - Subjectivity, Fact-Checking, Claim Normalization, and Retrieval T2 - Advances in Information Retrieval : 47th European Conference on Information Retrieval, ECIR 2025, Lucca, Italy, April 6–10, 2025, Proceedings, Part V N2 - The CheckThat! lab aims to advance the development of innovative technologies designed to identify and to counteract online disinformation and manipulation efforts across various languages and platforms. The first five editions of the CheckThat! lab focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. Since the 2023 edition, the lab has broadened the focus and addressed new problems on auxiliary tasks supporting research and decision-making during the verification process. In the 2025 edition of the lab, we consider tasks at the core of the verification pipeline again as well as auxiliary tasks: Task 1 is on identification of subjectivity (a follow up of the CheckThat! 2024 edition), Task 2 is on claim normalization, Task 3 addresses fact-checking numerical claims, and Task 4 focuses on scientific web discourse processing. These tasks represent challenging classification and retrieval problems at the document and at the span level, including multilingual settings. KW - Desinformation KW - Fehlinformation KW - Information Retrieval Y1 - 2025 SN - 978-3-031-88720-8 U6 - https://doi.org//10.1007/978-3-031-88720-8_68 SN - 0302-9743 SP - 467 EP - 478 PB - Springer International Publishing CY - Cham ER - TY - CHAP A1 - Alam, Firoj A1 - Struß, Julia Maria A1 - Chakraborty, Tanmoy A1 - Dietze, Stefan A1 - Hafid, Salim A1 - Korre, Katerina A1 - Muti, Arianna A1 - Nakov, Preslav A1 - Ruggeri, Federico A1 - Schellhammer, Sebastian A1 - Setty, Vinay A1 - Sundriyal, Megha A1 - Todorov, Konstantin A1 - Venktesh, V. ED - Carillo-de-Albornoz, Jorge ED - Seco de Herrera, Alba García ED - Gonzalo, Julio ED - Plaza, Laura ED - Mothe, Josiane ED - Piroi, Florina ED - Rosso, Paolo ED - Spina, Damiano ED - Faggiolo, Guglielmo ED - Ferro, Nicola T1 - Overview of the CLEF-2025 CheckThat! Lab : Subjectivity, Fact-Checking, Claim Normalization, and Retrieval T2 - Experimental IR Meets Multilinguality, Multimodality, and Interaction : 16th International Conference of the CLEF Association, CLEF 2025, Madrid, Spain, September 9–12, 2025, Proceedings N2 - This paper presents the eighth edition of the CheckThat! lab, part of the 2025 Conference and Labs of the Evaluation Forum (CLEF). As in previous editions of CheckThat!, the lab offers tasks from the core of the verification pipeline, including check-worthiness, identifying previously fact-checked claims, supporting evidence retrieval, and claim verification as well as auxiliary tasks addressing different facets of individual steps of the pipeline: Task 1 is on identification of subjectivity (a follow-up of the CheckThat! 2024 edition), which is related to the check-worthiness task, Task 2 is on claim normalization, Task 3 addresses fact-checking numerical claims, and Task 4 focuses on scientific web discourse processing. These challenging classification and retrieval problems are offered in different mono-, multi- and crosslingual settings covering more than 20 languages. This year, CheckThat! was one of the most popular labs at CLEF-2025 in terms of team registrations: 177 teams registered, almost half of them actually participating (a total of 83 teams) and 54 submitted system description papers. KW - Desinformation KW - Fehlinformation Y1 - 2025 SN - 978-3-032-04354-2 U6 - https://doi.org/10.1007/978-3-032-04354-2_13 SN - 1611-3349 EP - 199 PB - Springer International Publishing CY - Cham ER -