HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

A Language Model based Evaluator for Sentence Compression

{Akiko Aizawa Zhiyuan Luo Yang Zhao}

A Language Model based Evaluator for Sentence Compression

Abstract

We herein present a language-model-based evaluator for deletion-based sentence compression and view this task as a series of deletion-and-evaluation operations using the evaluator. More specifically, the evaluator is a syntactic neural language model that is first built by learning the syntactic and structural collocation among words. Subsequently, a series of trial-and-error deletion operations are conducted on the source sentences via a reinforcement learning framework to obtain the best target compression. An empirical study shows that the proposed model can effectively generate more readable compression, comparable or superior to several strong baselines. Furthermore, we introduce a 200-sentence test set for a large-scale dataset, setting a new baseline for the future research.

Benchmarks

BenchmarkMethodologyMetrics
sentence-compression-on-google-datasetBiRNN + LM Evaluator
CR: 0.39
F1: 0.851

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
A Language Model based Evaluator for Sentence Compression | Papers | HyperAI