Please use this identifier to cite or link to this item:
Title: Overview of the CLEF-2021 CheckThat! Lab Task 1 on check-worthiness estimation in tweets and political debates
Authors: Shaar, S.
Hasanain, M.
Hamdan, B.
Ali, Z.S.
Haouari, F.
Nikolov, A.
Kutlu, M.
Keywords: Check-worthiness estimation
Computational journalism
Detecting previously fact-checked claims
Social media verification
Verified claims retrieval
Petroleum reservoir evaluation
Data collection
Evaluation measures
Participating systems
Political debates
Research communities
Issue Date: 2021
Publisher: CEUR-WS
Abstract: We present an overview of Task 1 of the fourth edition of the CheckThat! Lab, part of the 2021 Conference and Labs of the Evaluation Forum (CLEF). The task asks to predict which posts in a Twitter stream are worth fact-checking, focusing on COVID-19 and politics in five languages: Arabic, Bulgarian, English, Spanish, and Turkish. A total of 15 teams participated in this task and most submissions managed to achieve sizable improvements over the baselines using Transformer-based models such as BERT and RoBERTa. Here, we describe the process of data collection and the task setup, including the evaluation measures, and we give a brief overview of the participating systems. We release to the research community all datasets from the lab as well as the evaluation scripts, which should enable further research in check-worthiness estimation for tweets and political debates. © 2021 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
Description: 2021 Working Notes of CLEF - Conference and Labs of the Evaluation Forum, CLEF-WN 2021 -- 21 September 2021 through 24 September 2021 -- 171327
ISSN: 1613-0073
Appears in Collections:Bilgisayar Mühendisliği Bölümü / Department of Computer Engineering
Scopus İndeksli Yayınlar Koleksiyonu / Scopus Indexed Publications Collection

Show full item record

CORE Recommender

Page view(s)

checked on Oct 2, 2023

Google ScholarTM


Items in GCRIS Repository are protected by copyright, with all rights reserved, unless otherwise indicated.