HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

LCSTS: A Large Scale Chinese Short Text Summarization Dataset

Baotian Hu; Qingcai Chen; Fangze Zhu

LCSTS: A Large Scale Chinese Short Text Summarization Dataset

Abstract

Automatic text summarization is widely regarded as the highly difficult problem, partially because of the lack of large text summarization data set. Due to the great challenge of constructing the large scale summaries for full text, in this paper, we introduce a large corpus of Chinese short text summarization dataset constructed from the Chinese microblogging website Sina Weibo, which is released to the public {http://icrc.hitsz.edu.cn/Article/show/139.html}. This corpus consists of over 2 million real Chinese short texts with short summaries given by the author of each text. We also manually tagged the relevance of 10,666 short summaries with their corresponding short texts. Based on the corpus, we introduce recurrent neural network for the summary generation and achieve promising results, which not only shows the usefulness of the proposed corpus for short text summarization research, but also provides a baseline for further research on this topic.

Code Repositories

CLUEbenchmark/CLGE
tf
Mentioned in GitHub
jessie0624/Automatic-Text-Summarization
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
text-summarization-on-lcstsLSTM-seq2seq
ROUGE-1: 46.48

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp