HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

A Masked Image Reconstruction Network for Document-level Relation Extraction

Liang Zhang Yidong Cheng

A Masked Image Reconstruction Network for Document-level Relation Extraction

Abstract

Document-level relation extraction aims to extract relations among entities within a document. Compared with its sentence-level counterpart, Document-level relation extraction requires inference over multiple sentences to extract complex relational triples. Previous research normally complete reasoning through information propagation on the mention-level or entity-level document-graphs, regardless of the correlations between the relationships. In this paper, we propose a novel Document-level Relation Extraction model based on a Masked Image Reconstruction network (DRE-MIR), which models inference as a masked image reconstruction problem to capture the correlations between relationships. Specifically, we first leverage an encoder module to get the features of entities and construct the entity-pair matrix based on the features. After that, we look on the entity-pair matrix as an image and then randomly mask it and restore it through an inference module to capture the correlations between the relationships. We evaluate our model on three public document-level relation extraction datasets, i.e. DocRED, CDR, and GDA. Experimental results demonstrate that our model achieves state-of-the-art performance on these three datasets and has excellent robustness against the noises during the inference process.

Benchmarks

BenchmarkMethodologyMetrics
relation-extraction-on-cdrDRE-MIR-SciBERT
F1: 76.6
relation-extraction-on-docredDRE-MIR-BERTbase
F1: 63.15
Ign F1: 61.03
relation-extraction-on-gdaDRE-MIR-SciBERT
F1: 86.4

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
A Masked Image Reconstruction Network for Document-level Relation Extraction | Papers | HyperAI