Please use this identifier to cite or link to this item: https://hdl.handle.net/20.500.11851/10903
Title: Overview of the CLEF-2023 CheckThat! Lab: Task 2 on Subjectivity in News Articles Notebook for the CheckThat! Lab at CLEF 2023
Authors: Galassi, A.
Ruggeri, F.
Barrón-Cedeño, A.
Alam, F.
Caselli, T.
Kutlu, M.
Antici F.
Keywords: Data augmentation
Foundation models
Multilingual trainings
Neural architectures
News articles
State of the art
Text fragments
Training strategy
Transformer modeling
Turkishs
Issue Date: 2023
Publisher: CEUR-WS
Abstract: We describe the outcome of the 2023 edition of the CheckThat!Lab at CLEF. We focus on subjectivity (Task 2), which has been proposed for the first time. It aims at fostering the technology for the identification of subjective text fragments in news articles. For that, we produced corpora consisting of 9,530 manually-annotated sentences, covering six languages —Arabic, Dutch, English, German, Italian, and Turkish. Task 2 attracted 12 teams, which submitted a total of 40 final runs covering all languages. The most successful approaches addressed the task using state-of-the-art multilingual transformer models, which were fine-tuned on language-specific data. Teams also experimented with a rich set of other neural architectures, including foundation models, zero-shot classifiers, and standard transformers, mainly coupled with data augmentation and multilingual training strategies to address class imbalance. We publicly release all the datasets and evaluation scripts, with the purpose of promoting further research on this topic. © 2023 Copyright for this paper by its authors.
Description: 24th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF-WN 2023 -- 18 September 2023 through 21 September 2023 -- 193170
URI: https://hdl.handle.net/20.500.11851/10903
ISSN: 1613-0073
Appears in Collections:Scopus İndeksli Yayınlar Koleksiyonu / Scopus Indexed Publications Collection

Show full item record



CORE Recommender

Google ScholarTM

Check





Items in GCRIS Repository are protected by copyright, with all rights reserved, unless otherwise indicated.