HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Ultra-Fine Entity Typing

Eunsol Choi; Omer Levy; Yejin Choi; Luke Zettlemoyer

Ultra-Fine Entity Typing

Abstract

We introduce a new entity typing task: given a sentence with an entity mention, the goal is to predict a set of free-form phrases (e.g. skyscraper, songwriter, or criminal) that describe appropriate types for the target entity. This formulation allows us to use a new type of distant supervision at large scale: head words, which indicate the type of the noun phrases they appear in. We show that these ultra-fine types can be crowd-sourced, and introduce new evaluation sets that are much more diverse and fine-grained than existing benchmarks. We present a model that can predict open types, and is trained using a multitask objective that pools our new head-word supervision with prior supervision from entity linking. Experimental results demonstrate that our model is effective in predicting entity types at varying granularity; it achieves state of the art performance on an existing fine-grained entity typing benchmark, and sets baselines for our newly-introduced datasets. Our data and model can be downloaded from: http://nlp.cs.washington.edu/entity_type

Code Repositories

uwnlp/open_type
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
entity-typing-on-ontonotes-v5-englishChoi et al. (2018) w augmentation
F1: 32.0
Precision: 47.1
Recall: 24.2
entity-typing-on-open-entity-1UFET-biLSTM
F1: 31.3

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp