HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

A simple but tough-to-beat baseline for the Fake News Challenge stance detection task

Benjamin Riedel; Isabelle Augenstein; Georgios P. Spithourakis; Sebastian Riedel

A simple but tough-to-beat baseline for the Fake News Challenge stance detection task

Abstract

Identifying public misinformation is a complicated and challenging task. An important part of checking the veracity of a specific claim is to evaluate the stance different news sources take towards the assertion. Automatic stance evaluation, i.e. stance detection, would arguably facilitate the process of fact checking. In this paper, we present our stance detection system which claimed third place in Stage 1 of the Fake News Challenge. Despite our straightforward approach, our system performs at a competitive level with the complex ensembles of the top two winning teams. We therefore propose our system as the 'simple but tough-to-beat baseline' for the Fake News Challenge stance detection task.

Code Repositories

gabrielsaruhashi/anti-fake
tf
Mentioned in GitHub
uclnlp/fakenewschallenge
tf
Mentioned in GitHub
pmallari/AmazonSentimentAnalysis
pytorch
Mentioned in GitHub
chimera-detector/Extension
Mentioned in GitHub
harshita97/hoaxbait
tf
Mentioned in GitHub
chimera-detector/Server
tf
Mentioned in GitHub
ankitp544/stance_detection
tf
Mentioned in GitHub
uclmr/fakenewschallenge
Official
tf
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
fake-news-detection-on-fnc-13rd place at FNC-1 - Team UCL Machine Reading (Riedel et al., 2017)
Per-class Accuracy (Agree): 44.04
Per-class Accuracy (Disagree): 6.60
Per-class Accuracy (Discuss): 81.38
Per-class Accuracy (Unrelated): 97.90
Weighted Accuracy: 81.72

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp