The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority

Jan 1, 2023·
Alberto Barrón-Cedeño
,
Firoj Alam
,
Tommaso Caselli
,
Giovanni Da San Martino
,
Tamer Elsayed
,
Andrea Galassi
,
Fatima Haouari
,
Federico Ruggeri
,
Julia Maria Struß
,
Rabindra Nath Nandi
,
Gullal S. Cheema
,
Dilshod Azizov
,
Preslav Nakov
· 1 min read
Abstract
The five editions of the CheckThat! lab so far have focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. The 2023 edition of the lab zooms into some of the problems and—for the first time—it offers five tasks in seven languages (Arabic, Dutch, English, German, Italian, Spanish, and Turkish): Task 1 asks to determine whether an item, text or a text plus an image, is check-worthy; Task 2 requires to assess whether a text snippet is subjective or not; Task 3 looks for estimating the political bias of a document or a news outlet; Task 4 requires to determine the level of factuality of a document or a news outlet; and Task 5 is about identifying authorities that should be trusted to verify a contended claim.
Type
Publication
Advances in Information Retrieval
publications_workshops

Add the full text or supplementary notes for the publication here using Markdown formatting.