020 Bibliotheks- und Informationswissenschaften
Filtern
Dokumenttyp
Volltext vorhanden
- nein (6)
Gehört zur Bibliographie
- ja (6)
Schlagworte
- Desinformation (3)
- COVID-19 (2)
- Fehlinformation (2)
- Bias (1)
- Datenkompetenz (1)
- Faktizität (1)
- Forschungsdaten (1)
- Fragebogen (1)
- Gemeindeverwaltung (1)
- Informations- und Dokumentationswissenschaft (1)
The CLEF-2024 CheckThat! Lab
(2024)
The first five editions of the CheckThat! lab focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. Since the 2023 edition, it has been focusing on new problems that can support the research and decision making during the verification process. In this new edition, we focus on new problems and -for the first time- we propose six tasks in fifteen languages (Arabic, Bulgarian, English, Dutch, French, Georgian, German, Greek, Italian, Polish, Portuguese, Russian, Slovene, Spanish, and code-mixed Hindi-English): Task 1 estimation of check-worthiness (the only task that has been present in all CheckThat! editions), Task 2 identification of subjectivity (a follow up of CheckThat! 2023 edition), Task 3 identification of persuasion (a follow up of SemEval 2023), Task 4 detection of hero, villain, and victim from memes (a follow up of CONSTRAINT 2022), Task 5 Rumor Verification using Evidence from Authorities (a first), and Task 6 robustness of credibility assessment with adversarial examples (a first). These tasks represent challenging classification and retrieval problems at the document and at the span level, including multilingual and multimodal settings.
We describe the sixth edition of the CheckThat! lab, part of the 2023 Conference and Labs of the Evaluation Forum (CLEF). The five previous editions of CheckThat! focused on the main tasks of the information verification pipeline: check-worthiness, verifying whether a claim was fact-checked before, supporting evidence retrieval, and claim verification. In this sixth edition, we zoom into some new problems and for the first time we offer five tasks in seven languages: Arabic, Dutch, English, German, Italian, Spanish, and Turkish. Task 1 asks to determine whether an item - text or text plus image- is check-worthy. Task 2 aims to predict whether a sentence from a news article is subjective or not. Task 3 asks to assess the political bias of the news at the article and at the media outlet level. Task 4 focuses on the factuality of reporting of news media. Finally, Task 5 looks at identifying authorities in Twitter that could help verify a given target claim. For a second year, CheckThat! was the most popular lab at CLEF-2023 in terms of team registrations: 127 teams. About one-third of them (a total of 37) actually participated.
We describe the outcome of the 2023 edition of the CheckThat!Lab at CLEF. We focus on subjectivity (Task 2), which has been proposed for the first time. It aims at fostering the technology for the identification of subjective text fragments in news articles. For that, we produced corpora consisting of 9,530 manually-annotated sentences, covering six languages - Arabic, Dutch, English, German, Italian, and Turkish. Task 2 attracted 12 teams, which submitted a total of 40 final runs covering all languages. The most successful approaches addressed the task using state-of-the-art multilingual transformer models, which were fine-tuned on language-specific data. Teams also experimented with a rich set of other neural architectures, including foundation models, zero-shot classifiers, and standard transformers, mainly coupled with data augmentation and multilingual training strategies to address class imbalance. We publicly release all the datasets and evaluation scripts, with the purpose of promoting further research on this topic.
In a time of climate change and growing activism, understanding how people access information is crucial. This research arises from ongoing government discussions on ecological policies and recent debates in Germany about ecological heating regulations and their cost implications. This study specifically focuses on the information seeking behavior on topics related to environmental sustainability. After reviewing existing research on information behavior, risk perception, and climate change communication, we investigate how participants search for information by surveying students. The findings could potentially inform strategies for sharing information and promoting action in Germany’s context of climate change and sustainability.
This paper presents a project that aims at supporting municipal stakeholders in rural areas by developing data-based applications in a collaborative process of stakeholders and a transfer team. In order to foster knowledge transfer in the domains of data literacy and data management on multiple levels a new approach is proposed that organizes the team competencies along the data life cycle.