000 Informatik, Wissen, Systeme
Filtern
Erscheinungsjahr
Dokumenttyp
Sprache
- Englisch (28) (entfernen)
Gehört zur Bibliographie
- ja (28)
Schlagworte
- Information Retrieval (8)
- Empfehlungssystem (6)
- Desinformation (5)
- Fehlinformation (5)
- Fact-checking (4)
- Check-worthiness estimation (3)
- Digital Humanities (3)
- Linked Data (3)
- Wissensmanagement (3)
- Benutzerforschung (2)
Institut
- FB5 Informationswissenschaften (28) (entfernen)
We describe the fourth edition of the CheckThat! Lab, part of the 2021 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality, and covers Arabic, Bulgarian, English, Spanish, and Turkish. Task 1 asks to predict which posts in a Twitter stream are worth fact-checking, focusing on COVID-19 and politics (in all five languages). Task 2 asks to determine whether a claim in a tweet can be verified using a set of previously fact-checked claims (in Arabic and English). Task 3 asks to predict the veracity of a news article and its topical domain (in English). The evaluation is based on mean average precision or precision at rank k for the ranking tasks, and macro-F1 for the classification tasks. This was the most popular CLEF-2021 lab in terms of team registrations: 132 teams. Nearly one-third of them participated: 15, 5, and 25 teams submitted official runs for tasks 1, 2, and 3, respectively.
Today research is in the midst of a global transformation that is usually referred to as Open Science. Open Science is a response from communities to global societal developments and to the digital transformation of research processes and leads to the emergence of new practices that are embedded in a digital ecosystem. The global Medieval Studies community is slowly adapting to this new culture that raises new questions around scientific practices. This article discusses three major pillars of Open Science: Open Access, Open Data, and Open Science Communication in the Digital Age. It considers the potential of these practices for individual researchers and for the role of medieval research in a modern society and explains good practices to start with.
We describe the fourth edition of the CheckThat! Lab, part of the 2021 Cross-Language Evaluation Forum (CLEF). The lab evaluates technology supporting various tasks related to factuality, and it is offered in Arabic, Bulgarian, English, and Spanish. Task 1 asks to predict which tweets in a Twitter stream are worth fact-checking (focusing on COVID-19). Task 2 asks to determine whether a claim in a tweet can be verified using a set of previously fact-checked claims. Task 3 asks to predict the veracity of a target news article and its topical domain. The evaluation is carried out using mean average precision or precision at rank k for the ranking tasks, and F1 for the classification tasks.
The 17th International Conference on Knowledge Management was held in the historic city of Potsdam, Germany. The conference was among the first post-pandemic face to face conferences, and the overall theme of the 17th edition of the ICKM conference rightly focused on “Knowledge, Uncertainty and Risks: From individual to global scale” at different levels of analysis and agency.
The fifth edition of the CheckThat! Lab is held as part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting various factuality tasks in seven languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 focuses on disinformation related to the ongoing COVID-19 infodemic and politics, and asks to predict whether a tweet is worth fact-checking, contains a verifiable factual claim, is harmful to the society, or is of interest to policy makers and why. Task 2 asks to retrieve claims that have been previously fact-checked and that could be useful to verify the claim in a tweet. Task 3 is to predict the veracity of a news article. Tasks 1 and 3 are classification problems, while Task 2 is a ranking one.
Overview of the CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection
(2022)
We describe the fifth edition of the CheckThat! lab, part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality in multiple languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 asks to identify relevant claims in tweets in terms of check-worthiness, verifiability, harmfullness, and attention-worthiness. Task 2 asks to detect previously fact-checked claims that could be relevant to fact-check a new claim. It targets both tweets and political debates/speeches. Task 3 asks to predict the veracity of the main claim in a news article. CheckThat! was the most popular lab at CLEF-2022 in terms of team registrations: 137 teams. More than one-third (37%) of them actually participated: 18, 7, and 26 teams submitted 210, 37, and 126 official runs for tasks 1, 2, and 3, respectively.
Reflecting on the history and development of the knowledge management discipline from an academic and applied research perspective, this chapter will outline the KM essentials as core of the discipline and open questions to be addressed in the future. Secondly, the author will discuss in particular the role of KM within organizational practice in regard to the overall societal challenges all organizations are facing today globally. Thirdly, the chapter will provide an outlook of the discipline in the light of future developments and suggests some research topics to be addressed by interdisciplinary KM research in the future. Beside on drawing on more than 35 years of experience in the KM field, this contribution will profit from previous research undertaken on the future of KM (2002 and 2012), contributions to guidelines and standards for KM (e.g., CEN, DIN, ISO), as well as from working with European Fortune 500 companies over the past 25 years.
The five editions of the CheckThat! lab so far have focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. The 2023 edition of the lab zooms into some of the problems and - for the first time - it offers five tasks in seven languages (Arabic, Dutch, English, German, Italian, Spanish, and Turkish): Task 1 asks to determine whether an item, text or a text plus an image, is check-worthy; Task 2 requires to assess whether a text snippet is subjective or not; Task 3 looks for estimating the political bias of a document or a news outlet; Task 4 requires to determine the level of factuality of a document or a news outlet; and Task 5 is about identifying authorities that should be trusted to verify a contended claim.