Please use this identifier to cite or link to this item: https://hdl.handle.net/20.500.11851/9933
Title: TOBB ETU at CheckThat! 2020: Prioritizing English and Arabic Claims Based on Check-Worthiness
Authors: Kartal, Y.S.
Kutlu, M.
Keywords: Controversial topics
Daily lives
Embeddings
Group-based
Hybrid approach
Logistics regressions
Word lists
Publisher: CEUR-WS
Abstract: Misinformation has many negative consequences on our daily life. While spread of misinformation is very fast, investigating veracity of claims is slow. Therefore, we urgently need systems helping human fact checkers in the combat against misinformation. In this paper, we present our participation in check-worthiness tasks (i.e., Task 1 and Task 5) of CLEF-2020 Check That! Lab. For English Task 1, we use logistic regression with fined-tuned BERT predictions, POS tags, controversial topics and a hand-crafted word list as features. For English Task 5, we again use logistic regression with fined-tuned BERT predictions and word embeddings as features. For Arabic Task 1, we use a hybrid approach of fined-tuned BERT model with the model used for English Task 5. For the Arabic task, we use AraBert as our Bert model. In the official evaluation of primary submissions, our primary models a) ranked 3rd in Arabic Task 1 based on P@30 and shared the 1st rank with another group based on P@5, b) ranked 5th in English Task 1 based on average precision and shared the 1st rank with five other groups based on reciprocal rank, P@1, P@3 and P@5 metrics, and c) ranked 3rd in Task 5 based on average precision. Copyright © 2020 for this paper by its authors.
Description: 11th Conference and Labs of the Evaluation Forum, CLEF 2020 -- 22 September 2020 through 25 September 2020 -- 163832
URI: https://hdl.handle.net/20.500.11851/9933
ISSN: 1613-0073
Appears in Collections:Scopus İndeksli Yayınlar Koleksiyonu / Scopus Indexed Publications Collection

Show full item record



CORE Recommender

Page view(s)

10
checked on Mar 25, 2024

Google ScholarTM

Check





Items in GCRIS Repository are protected by copyright, with all rights reserved, unless otherwise indicated.