HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

NumNet: Machine Reading Comprehension with Numerical Reasoning

Qiu Ran Yankai Lin Peng Li Jie Zhou Zhiyuan Liu

NumNet: Machine Reading Comprehension with Numerical Reasoning

Abstract

Numerical reasoning, such as addition, subtraction, sorting and counting is a critical skill in human's reading comprehension, which has not been well considered in existing machine reading comprehension (MRC) systems. To address this issue, we propose a numerical MRC model named as NumNet, which utilizes a numerically-aware graph neural network to consider the comparing information and performs numerical reasoning over numbers in the question and passage. Our system achieves an EM-score of 64.56% on the DROP dataset, outperforming all existing machine reading comprehension models by considering the numerical relations among numbers.

Code Repositories

ranqiu92/NumNet
Official
pytorch
wenhuchen/gnn-tabfact
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
question-answering-on-drop-testNumNet
F1: 67.97

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp