HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Entity, Relation, and Event Extraction with Contextualized Span Representations

David Wadden Ulme Wennberg Yi Luan Hannaneh Hajishirzi

Entity, Relation, and Event Extraction with Contextualized Span Representations

Abstract

We examine the capabilities of a unified, multi-task framework for three information extraction tasks: named entity recognition, relation extraction, and event extraction. Our framework (called DyGIE++) accomplishes all tasks by enumerating, refining, and scoring text spans designed to capture local (within-sentence) and global (cross-sentence) context. Our framework achieves state-of-the-art results across all tasks, on four datasets from a variety of domains. We perform experiments comparing different techniques to construct span representations. Contextualized embeddings like BERT perform well at capturing relationships among entities in the same or adjacent sentences, while dynamic span graph updates model long-range cross-sentence relationships. For instance, propagating span representations via predicted coreference links can enable the model to disambiguate challenging entity mentions. Our code is publicly available at https://github.com/dwadden/dygiepp and can be easily adapted for new tasks or datasets.

Code Repositories

dwadden/dygiepp
Official
pytorch
diffbot/knowledge-net
tf
Mentioned in GitHub
meiru-cam/coffee
pytorch
Mentioned in GitHub
rickltt/event_detection
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
joint-entity-and-relation-extraction-onDyGIE++
Cross Sentence: Yes
Entity F1: 67.50
Relation F1: 48.40
relation-extraction-on-ace-2005DYGIE++
Cross Sentence: Yes
NER Micro F1: 88.6
RE Micro F1: 63.4
Sentence Encoder: BERT base

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp