TY - CHAP A1 - Struß, Julia Maria A1 - Mihaljević, Helena A1 - Driesen, Maria ED - Eibl, Maximilian T1 - Where Is All the Data Hiding? BT - An Analysis of Hosting and Licensing Practices for Hate Speech Datasets T2 - Datenströme und Kulturoasen - Die Informationswissenschaft als Bindeglied zwischen den Informationswelten : Proceedings des 18. internationalen Symposiums für Informationswissenschaft (ISI 2025) N2 - The paper presents first results of a systematic review on datasets created to address the rise of hate speech and related phenomena in online communication, with a specific focus on hosting and licensing practices of these datasets. The analysis shows that while the majority of the 133 datasets has been directly accessible, over half have not been published via dedicated research data repositories, instead being hosted on GitHub. Additionally, almost 45% of the datasets have been released without any accompanying license. Contrary to expectations, the use of licenses and dedicated repositories has not increased over time. Furthermore, while datasets representing languages from the Global South were somewhat less frequently licensed and hosted on dedicated repositories, this trend was not statistically significant. Similarly, the data source itself had little measurable influence on licensing or hosting choices. KW - FAIR data principles KW - Forschungsdatenmanagement KW - Hassrede Y1 - 2025 SN - 978-3-86488-207-4 U6 - https://doi.org/10.5281/zenodo.14925654 SN - 0938-8710 SP - 190 EP - 203 PB - Verlag Werner Hülsbusch CY - Boizenburg ER - TY - CHAP A1 - Köhler, Juliane A1 - Struß, Julia Maria A1 - Driesen, Maria ED - Semar, Wolfgang T1 - Seeking for Information about Environmental Sustainability T2 - Nachhaltige Information – Information für Nachhaltigkeit N2 - In a time of climate change and growing activism, understanding how people access information is crucial. This research arises from ongoing government discussions on ecological policies and recent debates in Germany about ecological heating regulations and their cost implications. This study specifically focuses on the information seeking behavior on topics related to environmental sustainability. After reviewing existing research on information behavior, risk perception, and climate change communication, we investigate how participants search for information by surveying students. The findings could potentially inform strategies for sharing information and promoting action in Germany’s context of climate change and sustainability. KW - Nachhaltigkeit KW - Informationsversorgung KW - Fragebogen KW - Informationsverhalten KW - Klimaänderung Y1 - 2023 U6 - https://doi.org/10.5281/zenodo.10009338 SP - 404 EP - 410 PB - Verlag Werner Hülsbusch CY - Glückstadt ER - TY - CHAP A1 - Struß, Julia Maria A1 - Siegel, Melanie A1 - Ruppenhofer, Josef A1 - Wiegand, Michael A1 - Klenner, Manfred T1 - Overview of GermEval Task 2, 2019 shared task on the identification of offensive language T2 - Proceedings of the 15th Conference on Natural Language Processing (KONVENS 2019) N2 - We present the second edition of the GermEval Shared Task on the Identification of Offensive Language. This shared task deals with the classification of German tweets from Twitter. Two subtasks were continued from the first edition, namely a coarse-grained binary classification task and a fine-grained multi-class classification task. As a novel subtask, we introduce the classification of offensive tweets as explicit or implicit. The shared task had 13 participating groups submitting 28 runs for the coarse-grained task, another 28 runs for the fine-grained task, and 17 runs for the implicit-explicit task. We evaluate the results of the systems submitted to the shared task. The shared task homepage can be found at https://projects.fzai.h-da.de/iggsa/ KW - Automatische Spracherkennung KW - Beleidigung KW - Deutsch KW - Social Media KW - Tweet KW - Twitter Y1 - 2019 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:525-26209 UR - https://corpora.linguistik.uni-erlangen.de/data/konvens/proceedings/papers/germeval/GermEvalSharedTask2019Iggsa.pdf SP - 352 EP - 363 PB - German Society for Computational Linguistics & Language Technology und Friedrich-Alexander-Universität Erlangen-Nürnberg CY - München ER - TY - CHAP A1 - Nakov, Preslav A1 - Da San Martino, Giovanni A1 - Elsayed, Tamer A1 - Barrón-Cedeño, Alberto A1 - Míguez, Rúben A1 - Shaar, Shaden A1 - Alam, Firoj A1 - Haouari, Fatima A1 - Hasanain, Maram A1 - Babulkov, Nikolay A1 - Nikolov, Alex A1 - Shahi, Gautam Kishore A1 - Struß, Julia Maria A1 - Mandl, Thomas T1 - The CLEF-2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News T2 - Advances in Information Retrieval N2 - We describe the fourth edition of the CheckThat! Lab, part of the 2021 Cross-Language Evaluation Forum (CLEF). The lab evaluates technology supporting various tasks related to factuality, and it is offered in Arabic, Bulgarian, English, and Spanish. Task 1 asks to predict which tweets in a Twitter stream are worth fact-checking (focusing on COVID-19). Task 2 asks to determine whether a claim in a tweet can be verified using a set of previously fact-checked claims. Task 3 asks to predict the veracity of a target news article and its topical domain. The evaluation is carried out using mean average precision or precision at rank k for the ranking tasks, and F1 for the classification tasks. KW - Fake news KW - Fact-checking KW - Falschmeldung KW - Desinformation KW - Fehlinformation Y1 - 2021 SN - 978-3-030-72240-1 U6 - https://doi.org/10.1007/978-3-030-72240-1_75 SP - 639 EP - 649 PB - Springer CY - Cham ER - TY - CHAP A1 - Nakov, Preslav A1 - Da San Martino, Giovanni A1 - Elsayed, Tamer A1 - Barrón-Cedeño, Alberto A1 - Míguez, Rubén A1 - Shaar, Shaden A1 - Alam, Firoj A1 - Haouari, Fatima A1 - Hasanain, Maram A1 - Mansour, Watheq A1 - Hamdan, Bayan A1 - Sheikh Ali, Zien A1 - Babulkov, Nikolay A1 - Nikolov, Alex A1 - Koshore Shahi, Gautam A1 - Struß, Julia Maria A1 - Mandl, Thomas A1 - Kutlu, Mucahid A1 - Selim Kartal, Yavuz T1 - Overview of the CLEF–2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News T2 - Experimental IR Meets Multilinguality, Multimodality, and Interaction N2 - We describe the fourth edition of the CheckThat! Lab, part of the 2021 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality, and covers Arabic, Bulgarian, English, Spanish, and Turkish. Task 1 asks to predict which posts in a Twitter stream are worth fact-checking, focusing on COVID-19 and politics (in all five languages). Task 2 asks to determine whether a claim in a tweet can be verified using a set of previously fact-checked claims (in Arabic and English). Task 3 asks to predict the veracity of a news article and its topical domain (in English). The evaluation is based on mean average precision or precision at rank k for the ranking tasks, and macro-F1 for the classification tasks. This was the most popular CLEF-2021 lab in terms of team registrations: 132 teams. Nearly one-third of them participated: 15, 5, and 25 teams submitted official runs for tasks 1, 2, and 3, respectively. KW - Fact-checking KW - Check-worthiness estimation KW - Desinformation KW - Fehlinformation Y1 - 2021 SN - 978-3-030-85251-1 U6 - https://doi.org/10.1007/978-3-030-85251-1_19 SP - 264 EP - 291 PB - Springer CY - Cham ER - TY - CHAP A1 - Kastner, Sebastian A1 - Mandl, Thomas A1 - Struß, Julia Maria T1 - Identifikation von Kundenrezensionen im WWW als Basis eines Crawlers für das Opinion Mining T2 - Informationswissenschaft zwischen virtueller Infrastruktur und materiellen Lebenswelten : Proceedings des 13. Internationalen Symposiums für Informationswissenschaft (ISI 2013), Potsdam, 19. bis 22. März 2013 / hrsg. von Hans-Christoph Hobohm. - Glückstadt: Hülsbusch, 2013. - 502 S. ISBN 978-3-86488-035-3 N2 - Diese Arbeit befasst sich mit der Klassifikation von Webseiten in solche, die Kundenrezensionen zu Produkten oder Dienstleistungen enthalten und solche, die keine enthalten. Die derart gewonnenen Rezensionen können anschließend als Input für Opinion-Mining-Systeme dienen, die sich mit der Extraktion und Klassifikation von Meinungen z. B. in der genannten Textsorte beschäftigen. Erste Evaluierungsergebnisse deuten mit einer Accuracy von 91 Prozent auf einen vielversprechenden Ansatz hin. KW - Klassifikation KW - Web-Seite KW - Rezension KW - Demoskopie KW - Bewertung Y1 - 2013 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:525-4259 ER - TY - CHAP A1 - Köhler, Juliane A1 - Shahi, Gautam Kishore A1 - Struß, Julia Maria A1 - Wiegand, Michael A1 - Siegel, Melanie A1 - Mandl, Thomas A1 - Schütz, Mina ED - Faggiolo, Guglielmo ED - Ferro, Nicola ED - Hanburry, Allan ED - Potthast, Martin T1 - Overview of the CLEF-2022 CheckThat! Lab: Task 3 on Fake News Detection T2 - CLEF 2022 Working Notes : Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum N2 - This paper describes the results of the CheckThat! Lab 2022 Task 3. This is the fifth edition of the lab, which concentrates on the evaluation of technologies supporting three tasks related to factuality. Task 3 is designed as a multi-class classification problem and focuses on the veracity of German and English news articles. The German subtask is ought to be solved using an cross-lingual approach while the English subtask was offered as mono-lingual task. The participants of the lab were provided an English training, development and test dataset as well as a German test dataset. In total, 25 teams submitted successful runs for the English subtask and 8 for the German subtask. The best performing system for the mono-lingual subtask achieved a macro F1-score of 0.339. The best system for the cross-lingual task achieved a macro F1-score of 0.242. In the paper at hand we will elaborate on the process of data collection, the task setup, the evaluation results and give a brief overview of the participating systems. KW - Deep Learning KW - Desinformation KW - Fehlinformation Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0074-3180-7 UR - https://ceur-ws.org/Vol-3180/paper-30.pdf SN - 1613-0073 SP - 404 EP - 421 CY - Bologna ER - TY - CHAP A1 - Struß, Julia Maria A1 - Ruggeri, Federico A1 - Barrón-Cedeño, Alberto A1 - Alam, Firoj A1 - Dimitrov, Dimitar A1 - Galassi, Andrea A1 - Pachov, Georgi A1 - Koychev, Ivan A1 - Nakov, Preslav A1 - Siegel, Melanie A1 - Wiegand, Michael A1 - Hasanain, Maram A1 - Suwaileh, Reem A1 - Zaghouani, Wajdi ED - Faggioli, Guglielmo ED - Ferro, Nicola ED - Galuščáková, Petra ED - Seco de Herrera, Alba García T1 - Overview of the CLEF-2024 CheckThat! Lab Task 2 on Subjectivity in News Articles BT - Notebook for the CheckThat! Lab at CLEF 2024 T2 - CLEF 2024 Working Notes : Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024) N2 - We present an overview of Task 2 of the seventh edition of the CheckThat! lab at the 2024 iteration of the Conference and Labs of the Evaluation Forum (CLEF). The task focuses on subjectivity detection in news articles and was o ered in five languages: Arabic, Bulgarian, English, German, and Italian, as well as in a multilingual setting. The datasets for each language were carefully curated and annotated, comprising over 10,000 sentences from news articles. The task challenged participants to develop systems capable of distinguishing between subjective statements (refecting personal opinions or biases) and objective ones (presenting factual information) at the sentence level. A total of 15 teams participated in the task, submitting 36 valid runs across all language tracks. The participants used a variety of approaches, with transformer-based models being the most popular choice. Strategies included fine-tuning monolingual and multilingual models, and leveraging English models with automatic translation for the non-English datasets. Some teams also explored ensembles, feature engineering, and innovative techniques such as few-shot learning and in-context learning with large language models. The evaluation was based on macro-averaged F1 score. The results varied across languages, with the best performance achieved for Italian and German, followed by English. The Arabic track proved particularly challenging, with no team surpassing an F1 score of 0.50. This task contributes to the broader goal of enhancing the reliability of automated content analysis in the context of misinformation detection and fact-checking. The paper provides detailed insights into the datasets, participant approaches, and results, o ering a benchmark for the current state of subjectivity detection across multiple languages. KW - Fehlinformation KW - Zeitungsartikel Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0074-3740-3 UR - https://ceur-ws.org/Vol-3740/paper-25.pdf SN - 1613-0073 SP - 287 EP - 298 CY - Frankreich ER - TY - CHAP A1 - Barrón-Cedeño, Alberto A1 - Alam, Firoj A1 - Chakraborty, Tonmoy A1 - Elsayed, Tamer A1 - Nakov, Preslav A1 - Przybyła, Piotr A1 - Struß, Julia Maria A1 - Haouari, Fatima A1 - Hasanain, Maram A1 - Ruggeri, Federico A1 - Song, Xingyi A1 - Suwaileh, Reem ED - Goharian, Nazli ED - Tonellotto, Nicola ED - He, Yulan ED - Lipani, Aldo ED - McDonald, Graham ED - Macdonald, Craig ED - Ounis, Iadh T1 - The CLEF-2024 CheckThat! Lab BT - Check-Worthiness, Subjectivity, Persuasion, Roles, Authorities, and Adversarial Robustness T2 - Advances in Information Retrieval N2 - The first five editions of the CheckThat! lab focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. Since the 2023 edition, it has been focusing on new problems that can support the research and decision making during the verification process. In this new edition, we focus on new problems and -for the first time- we propose six tasks in fifteen languages (Arabic, Bulgarian, English, Dutch, French, Georgian, German, Greek, Italian, Polish, Portuguese, Russian, Slovene, Spanish, and code-mixed Hindi-English): Task 1 estimation of check-worthiness (the only task that has been present in all CheckThat! editions), Task 2 identification of subjectivity (a follow up of CheckThat! 2023 edition), Task 3 identification of persuasion (a follow up of SemEval 2023), Task 4 detection of hero, villain, and victim from memes (a follow up of CONSTRAINT 2022), Task 5 Rumor Verification using Evidence from Authorities (a first), and Task 6 robustness of credibility assessment with adversarial examples (a first). These tasks represent challenging classification and retrieval problems at the document and at the span level, including multilingual and multimodal settings. KW - Desinformation KW - Subjektivität KW - Bias KW - Faktizität Y1 - 2024 SN - 978-3-031-56069-9 U6 - https://doi.org/10.1007/978-3-031-56069-9_62 SN - 0302-9743 SP - 449 EP - 458 PB - Springer International Publishing CY - Cham ER - TY - CHAP A1 - Barrón-Cedeño, Alberto A1 - Alam, Firoj A1 - Caselli, Tommaso A1 - Da San Martino, Giovanni A1 - Elsayed, Tamer A1 - Galassi, Andrea A1 - Haouari, Fatima A1 - Ruggeri, Federico A1 - Struß, Julia Maria A1 - Nath Nandi, Rabindra A1 - Cheema, Gullal S. A1 - Azizov, Dilshod A1 - Nakov, Preslav T1 - The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority T2 - Advances in Information Retrieval : 45th European Conference on Information Retrieval, ECIR 2023, Dublin, Ireland, April 2–6, 2023, Proceedings, Part III N2 - The five editions of the CheckThat! lab so far have focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. The 2023 edition of the lab zooms into some of the problems and - for the first time - it offers five tasks in seven languages (Arabic, Dutch, English, German, Italian, Spanish, and Turkish): Task 1 asks to determine whether an item, text or a text plus an image, is check-worthy; Task 2 requires to assess whether a text snippet is subjective or not; Task 3 looks for estimating the political bias of a document or a news outlet; Task 4 requires to determine the level of factuality of a document or a news outlet; and Task 5 is about identifying authorities that should be trusted to verify a contended claim. KW - Desinformation KW - Fehlinformation KW - Bias Y1 - 2023 SN - 978-3-031-28241-6 U6 - https://doi.org/10.1007/978-3-031-28241-6_59 SN - 0302-9743 SP - 509 EP - 517 PB - Springer CY - Cham ER - TY - CHAP A1 - Struß, Julia Maria A1 - Lewandowski, Dirk T1 - Methoden in der Informationswissenschaft T2 - Grundlagen der Informationswissenschaft KW - Informations- und Dokumentationswissenschaft KW - Methode KW - Wissenschaftliches Arbeiten Y1 - 2023 SN - 978-3-11-076904-3 U6 - https://doi.org/10.1515/9783110769043-004 SP - 57 EP - 69 PB - DeGruyter CY - Berlin ER - TY - CHAP A1 - Barrón-Cedeño, Alberto A1 - Alam, Firoj A1 - Struß, Julia Maria A1 - Nakov, Preslav A1 - Chakraborty, Tanmoy A1 - Elsayed, Tamer A1 - Przybyła, Piotr A1 - Caselli, Tommaso A1 - Da San Martino, Giovanni A1 - Haouari, Fatima A1 - Hasanain, Maram A1 - Li, Chengkai A1 - Piskorski, Jakub A1 - Ruggeri, Federico A1 - Song, Xingyi A1 - Suwaileh, Reem ED - Goeuriot, Lorraine ED - Mulhem, Philippe ED - Quénot, Georges ED - Schwab, Didier ED - Di Nunzio, Giorgio Maria ED - Soulier, Laure ED - Galušcáková, Petra ED - Seco de Herrera, Alba García ED - Faggioli, Guglielmo ED - Ferro, Nicola T1 - Overview of the CLEF-2024 CheckThat! Lab : Check-Worthiness, Subjectivity, Persuasion, Roles, Authorities, and Adversarial Robustness T2 - Experimental IR Meets Multilinguality, Multimodality, and Interaction : 15th International Conference of the CLEF Association, CLEF 2024, Grenoble, France, September 9–12, 2024, Proceedings, Part II N2 - We describe the seventh edition of the CheckThat! lab, part of the 2024 Conference and Labs of the Evaluation Forum (CLEF). Previous editions of CheckThat! focused on the main tasks of the information verification pipeline: check-worthiness, identifying previously fact-checked claims, supporting evidence retrieval, and claim verification. In this edition, we introduced some new challenges, offering six tasks in fifteen languages (Arabic, Bulgarian, English, Dutch, French, Georgian, German, Greek, Italian, Polish, Portuguese, Russian, Slovene, Spanish, and code-mixed Hindi-English): Task 1 on estimation of check-worthiness (the only task that has been present in all CheckThat! editions), Task 2 on identification of subjectivity (a follow up of the CheckThat! 2023 edition), Task 3 on identification of the use of persuasion techniques (a follow up of SemEval 2023), Task 4 on detection of hero, villain, and victim from memes (a follow up of CONSTRAINT 2022), Task 5 on rumor verification using evidence from authorities (new task), and Task 6 on robustness of credibility assessment with adversarial examples (new task). These are challenging classification and retrieval problems at the document and at the span level, including multilingual and multimodal settings. This year, CheckThat! was one of the most popular labs at CLEF-2024 in terms of team registrations: 130 teams. More than one-third of them (a total of 46) actually participated. KW - Desinformation KW - Fehlinformation Y1 - 2024 SN - 978-3-031-71907-3 U6 - https://doi.org/10.1007/978-3-031-71908-0 SP - 28 EP - 52 PB - Springer Nature CY - Berlin ER - TY - CHAP A1 - Mandl, Thomas A1 - Struß, Julia Maria ED - Heisig, Peter T1 - Information retrieval BT - Core techniques, issues, current and future developments T2 - Handbook on Information Sciences KW - Indexierung KW - Information Retrieval KW - Natürliche Sprache KW - Suchmaschine Y1 - 2024 SN - 978-1-0353-4369-0 U6 - https://doi.org/10.4337/9781035343706.00016 SP - 137 EP - 151 PB - Edward Elgar Publishing CY - Cheltenham ER - TY - CHAP A1 - Barrón-Cedeño, Alberto A1 - Alam, Firoj A1 - Galassi, Andrea A1 - Da San Martino, Giovanni A1 - Nakov, Preslav A1 - Elsayed, Tamer A1 - Azizov, Dilshod A1 - Caselli, Tommaso A1 - Cheema, Gullal S. A1 - Haouari, Fatima A1 - Hasanain, Maram A1 - Kutlu, Mucahid A1 - Li, Chengkai A1 - Ruggeri, Federico A1 - Struß, Julia Maria A1 - Zaghouani, Wajdi ED - Arampatzis, Avi ED - Kanoulas, Evangelos ED - Tsikrika, Theodora ED - Vrochidis, Stefanos ED - Giachanou, Anastasia ED - Li, Dan ED - Aliannejadi, Mohammad ED - Vlachos, Michalis ED - Faggioli, Guglielmo ED - Ferro, Nicola T1 - Overview of the CLEF–2023 CheckThat! Lab on Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority of News Articles and Their Source T2 - Experimental IR Meets Multilinguality, Multimodality, and Interaction N2 - We describe the sixth edition of the CheckThat! lab, part of the 2023 Conference and Labs of the Evaluation Forum (CLEF). The five previous editions of CheckThat! focused on the main tasks of the information verification pipeline: check-worthiness, verifying whether a claim was fact-checked before, supporting evidence retrieval, and claim verification. In this sixth edition, we zoom into some new problems and for the first time we offer five tasks in seven languages: Arabic, Dutch, English, German, Italian, Spanish, and Turkish. Task 1 asks to determine whether an item - text or text plus image- is check-worthy. Task 2 aims to predict whether a sentence from a news article is subjective or not. Task 3 asks to assess the political bias of the news at the article and at the media outlet level. Task 4 focuses on the factuality of reporting of news media. Finally, Task 5 looks at identifying authorities in Twitter that could help verify a given target claim. For a second year, CheckThat! was the most popular lab at CLEF-2023 in terms of team registrations: 127 teams. About one-third of them (a total of 37) actually participated. KW - Desinformation KW - Fehlinformation KW - COVID-19 Y1 - 2023 SN - 978-3-031-42448-9 U6 - https://doi.org/10.1007/978-3-031-42448-9_20 SN - 1611-3349 SP - 251 EP - 275 PB - Springer International Publishing CY - Cham ER - TY - CHAP A1 - Galassi, Andrea A1 - Ruggeri, Federico A1 - Barrón-Cedeño, Alberto A1 - Alam, Firoj A1 - Caselli, Tommaso A1 - Kutlu, Mucahid A1 - Struß, Julia Maria A1 - Antici, Francesco A1 - Hasanain, Maram A1 - Köhler, Juliane A1 - Korre, Katerina A1 - Leistra, Folkert A1 - Muti, Arianna A1 - Siegel, Melanie A1 - Türkmen, Mehmet Deniz A1 - Wiegand, Michael A1 - Zaghouani, Wajdi ED - Aliannejadi, Mohammad ED - Faggiolo, Guglielmo ED - Ferro, Nicola ED - Vlachos, Michalis T1 - Overview of the CLEF-2023 CheckThat! Lab: Task 2 on Subjectivity in News Articles BT - Notebook for the CheckThat! Lab at CLEF 2023 T2 - CLEF 2023 Working Notes N2 - We describe the outcome of the 2023 edition of the CheckThat!Lab at CLEF. We focus on subjectivity (Task 2), which has been proposed for the first time. It aims at fostering the technology for the identification of subjective text fragments in news articles. For that, we produced corpora consisting of 9,530 manually-annotated sentences, covering six languages - Arabic, Dutch, English, German, Italian, and Turkish. Task 2 attracted 12 teams, which submitted a total of 40 final runs covering all languages. The most successful approaches addressed the task using state-of-the-art multilingual transformer models, which were fine-tuned on language-specific data. Teams also experimented with a rich set of other neural architectures, including foundation models, zero-shot classifiers, and standard transformers, mainly coupled with data augmentation and multilingual training strategies to address class imbalance. We publicly release all the datasets and evaluation scripts, with the purpose of promoting further research on this topic. KW - Desinformation KW - Fehlinformation KW - COVID-19 Y1 - 2023 UR - https://ceur-ws.org/Vol-3497/paper-020.pdf SP - 236 EP - 249 CY - Thessaloniki ER - TY - CHAP A1 - Higi, Leonard A1 - Neuroth, Heike A1 - Struß, Julia Maria ED - Semar, Wolfgang T1 - From Data Life Cycle to Urban Data Practice BT - Data-based Application Development for Municipal Stakeholders in Rural Areas Organized along the Data Life Cycle T2 - Nachhaltige Information – Information für Nachhaltigkeit N2 - This paper presents a project that aims at supporting municipal stakeholders in rural areas by developing data-based applications in a collaborative process of stakeholders and a transfer team. In order to foster knowledge transfer in the domains of data literacy and data management on multiple levels a new approach is proposed that organizes the team competencies along the data life cycle. KW - Forschungsdaten KW - Datenkompetenz KW - Gemeindeverwaltung KW - Öffentlicher Dienst KW - Stadtforschung Y1 - 2023 SN - 978-3-86488-200-5 U6 - https://doi.org/10.5281/zenodo.10009338 SN - 0938-8710 SP - 393 EP - 400 PB - Verlag Werner Hülsbusch CY - Glückstadt ER - TY - CHAP A1 - Nakov, Preslav A1 - Barrón-Cedeño, Alberto A1 - Da San Martino, Giovanni A1 - Alam, Firoj A1 - Struß, Julia Maria A1 - Mandl, Thomas A1 - Míguez, Rubén A1 - Caselli, Tommaso A1 - Kutlu, Mucahid A1 - Zaghouani, Wajdi A1 - Li, Chengkai A1 - Shaar, Shaden A1 - Shahi, Gautam Kishore A1 - Mubarak, Hamdy A1 - Nikolov, Alex A1 - Babulkov, Nikolay A1 - Kartal, Yavuz Selim A1 - Wiegand, Michael A1 - Siegel, Melanie A1 - Köhler, Juliane T1 - Overview of the CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection T2 - Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2022. N2 - We describe the fifth edition of the CheckThat! lab, part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality in multiple languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 asks to identify relevant claims in tweets in terms of check-worthiness, verifiability, harmfullness, and attention-worthiness. Task 2 asks to detect previously fact-checked claims that could be relevant to fact-check a new claim. It targets both tweets and political debates/speeches. Task 3 asks to predict the veracity of the main claim in a news article. CheckThat! was the most popular lab at CLEF-2022 in terms of team registrations: 137 teams. More than one-third (37%) of them actually participated: 18, 7, and 26 teams submitted 210, 37, and 126 official runs for tasks 1, 2, and 3, respectively. KW - Check-worthiness estimation KW - Fact-checking KW - Desinformation KW - Fehlinformation KW - COVID-19 Y1 - 2022 SN - 978-3-031-13643-6 U6 - https://doi.org/10.1007/978-3-031-13643-6_29 SN - 0302-9743 SP - 495 EP - 520 PB - Springer CY - Cham ER - TY - CHAP A1 - Nakov, Preslav A1 - Barrón-Cedeño, Alberto A1 - Da San Martino, Giovanni A1 - Alam, Firoj A1 - Struß, Julia Maria A1 - Mandl, Thomas A1 - Míguez, Rubén A1 - Caselli, Tommaso A1 - Kutlu, Mucahid A1 - Zaghouani, Wajdi A1 - Li, Chengkai A1 - Shaar, Shaden A1 - Shahi, Gautam Kishore A1 - Mubarak, Hamdy A1 - Nikolov, Alex A1 - Babulkov, Nikolay A1 - Kartal, Yavuz Selim A1 - Beltrán, Javier T1 - The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection T2 - Advances in Information Retrieval. ECIR 2022 N2 - The fifth edition of the CheckThat! Lab is held as part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting various factuality tasks in seven languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 focuses on disinformation related to the ongoing COVID-19 infodemic and politics, and asks to predict whether a tweet is worth fact-checking, contains a verifiable factual claim, is harmful to the society, or is of interest to policy makers and why. Task 2 asks to retrieve claims that have been previously fact-checked and that could be useful to verify the claim in a tweet. Task 3 is to predict the veracity of a news article. Tasks 1 and 3 are classification problems, while Task 2 is a ranking one. KW - Desinformation KW - Fehlinformation KW - COVID-19 KW - Fact-checking KW - Check-worthiness estimation Y1 - 2022 SN - 978-3-030-99739-7 U6 - https://doi.org/10.1007/978-3-030-99739-7_52 SN - 0302-9743 SP - 416 EP - 428 PB - Springer CY - Cham ER - TY - CHAP A1 - Alam, Firoj A1 - Struß, Julia Maria A1 - Chakraborty, Tanmoy A1 - Dietze, Stefan A1 - Hafid, Salim A1 - Korre, Katerina A1 - Muti, Arianna A1 - Nakov, Preslav A1 - Ruggeri, Federico A1 - Schellhammer, Sebastian A1 - Setty, Vinay A1 - Sundriyal, Megha A1 - Todorov, Konstantin A1 - Venktesh, V. ED - Hauff, Claudia ED - Macdonald, Craig ED - Jannach, Dietmar ED - Nardini, Franco Maria ED - Pinelli, Fabio ED - Silvestri, Fabrizio ED - Tonellotto, Nicola T1 - The CLEF-2025 CheckThat! Lab BT - Subjectivity, Fact-Checking, Claim Normalization, and Retrieval T2 - Advances in Information Retrieval : 47th European Conference on Information Retrieval, ECIR 2025, Lucca, Italy, April 6–10, 2025, Proceedings, Part V N2 - The CheckThat! lab aims to advance the development of innovative technologies designed to identify and to counteract online disinformation and manipulation efforts across various languages and platforms. The first five editions of the CheckThat! lab focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. Since the 2023 edition, the lab has broadened the focus and addressed new problems on auxiliary tasks supporting research and decision-making during the verification process. In the 2025 edition of the lab, we consider tasks at the core of the verification pipeline again as well as auxiliary tasks: Task 1 is on identification of subjectivity (a follow up of the CheckThat! 2024 edition), Task 2 is on claim normalization, Task 3 addresses fact-checking numerical claims, and Task 4 focuses on scientific web discourse processing. These tasks represent challenging classification and retrieval problems at the document and at the span level, including multilingual settings. KW - Desinformation KW - Fehlinformation KW - Information Retrieval Y1 - 2025 SN - 978-3-031-88720-8 U6 - https://doi.org//10.1007/978-3-031-88720-8_68 SN - 0302-9743 SP - 467 EP - 478 PB - Springer International Publishing CY - Cham ER -