HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Adversarial Transfer Learning for Chinese Named Entity Recognition with Self-Attention Mechanism

{Yubo Chen Pengfei Cao Jun Zhao Shengping Liu Kang Liu}

Adversarial Transfer Learning for Chinese Named Entity Recognition with Self-Attention Mechanism

Abstract

Named entity recognition (NER) is an important task in natural language processing area, which needs to determine entities boundaries and classify them into pre-defined categories. For Chinese NER task, there is only a very small amount of annotated data available. Chinese NER task and Chinese word segmentation (CWS) task have many similar word boundaries. There are also specificities in each task. However, existing methods for Chinese NER either do not exploit word boundary information from CWS or cannot filter the specific information of CWS. In this paper, we propose a novel adversarial transfer learning framework to make full use of task-shared boundaries information and prevent the task-specific features of CWS. Besides, since arbitrary character can provide important cues when predicting entity type, we exploit self-attention to explicitly capture long range dependencies between two tokens. Experimental results on two different widely used datasets show that our proposed model significantly and consistently outperforms other state-of-the-art methods.

Benchmarks

BenchmarkMethodologyMetrics
chinese-named-entity-recognition-on-sighannerBiLSTM+CRF+adversarial+self-attention
F1: 90.64
chinese-named-entity-recognition-on-weibo-nerBiLSTM+CRF+adversarial+self-attention
F1: 53.08

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Adversarial Transfer Learning for Chinese Named Entity Recognition with Self-Attention Mechanism | Papers | HyperAI