TY - CHAP A1 - Köhler, Juliane A1 - Shahi, Gautam Kishore A1 - Struß, Julia Maria A1 - Wiegand, Michael A1 - Siegel, Melanie A1 - Mandl, Thomas A1 - Schütz, Mina ED - Faggiolo, Guglielmo ED - Ferro, Nicola ED - Hanburry, Allan ED - Potthast, Martin T1 - Overview of the CLEF-2022 CheckThat! Lab: Task 3 on Fake News Detection T2 - CLEF 2022 Working Notes : Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum N2 - This paper describes the results of the CheckThat! Lab 2022 Task 3. This is the fifth edition of the lab, which concentrates on the evaluation of technologies supporting three tasks related to factuality. Task 3 is designed as a multi-class classification problem and focuses on the veracity of German and English news articles. The German subtask is ought to be solved using an cross-lingual approach while the English subtask was offered as mono-lingual task. The participants of the lab were provided an English training, development and test dataset as well as a German test dataset. In total, 25 teams submitted successful runs for the English subtask and 8 for the German subtask. The best performing system for the mono-lingual subtask achieved a macro F1-score of 0.339. The best system for the cross-lingual task achieved a macro F1-score of 0.242. In the paper at hand we will elaborate on the process of data collection, the task setup, the evaluation results and give a brief overview of the participating systems. KW - Deep Learning KW - Desinformation KW - Fehlinformation Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0074-3180-7 UR - https://ceur-ws.org/Vol-3180/paper-30.pdf SN - 1613-0073 SP - 404 EP - 421 CY - Bologna ER -