Please use this identifier to cite or link to this item:
https://hdl.handle.net/20.500.11851/8298
Title: | Overview of the CLEF-2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News | Authors: | Nakov, Preslav Martino, Giovanni Da San Elsayed, Tamer Barron-Cedeno, Alberto Miguez, Ruben Shaar, Shaden Kartal, Yavuz Selim |
Keywords: | Fact-Checking Disinformation Misinformation Check-Worthiness Estimation Verified Claim Retrieval Fake News Detection COVID-19 |
Publisher: | Springer international Publishing Ag | Series/Report no.: | Lecture Notes in Computer Science | Abstract: | We describe the fourth edition of the CheckThat! Lab, part of the 2021 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality, and covers Arabic, Bulgarian, English, Spanish, and Turkish. Task 1 asks to predict which posts in a Twitter stream are worth fact-checking, focusing on COVID-19 and politics (in all five languages). Task 2 asks to determine whether a claim in a tweet can be verified using a set of previously fact-checked claims (in Arabic and English). Task 3 asks to predict the veracity of a news article and its topical domain (in English). The evaluation is based on mean average precision or precision at rank k for the ranking tasks, and macro-F1 for the classification tasks. This was the most popular CLEF-2021 lab in terms of team registrations: 132 teams. Nearly one-third of them participated: 15, 5, and 25 teams submitted official runs for tasks 1, 2, and 3, respectively. | Description: | Kartal, Yavuz Selim/0000-0002-2146-2680; Mansour, Watheq/0000-0002-9463-595X; Mandl, Thomas/0000-0002-8398-9699; Hasanain, Maram/0000-0002-7466-178X; Struss, Julia Maria/0000-0001-9133-4978; Haouari, Fatima/0000-0003-4842-2467; Shahi, Gautam Kishore/0000-0001-6168-0132 | URI: | https://doi.org/10.1007/978-3-030-85251-1_19 | ISBN: | 9783030852504 9783030852511 |
ISSN: | 0302-9743 1611-3349 |
Appears in Collections: | Bilgisayar Mühendisliği Bölümü / Department of Computer Engineering Scopus İndeksli Yayınlar Koleksiyonu / Scopus Indexed Publications Collection WoS İndeksli Yayınlar Koleksiyonu / WoS Indexed Publications Collection |
Show full item record
CORE Recommender
SCOPUSTM
Citations
61
checked on Aug 23, 2025
Page view(s)
98
checked on Aug 18, 2025
Google ScholarTM
Check
Altmetric
Items in GCRIS Repository are protected by copyright, with all rights reserved, unless otherwise indicated.