Command Palette
Search for a command to run...
SARG: A Novel Semi Autoregressive Generator for Multi-turn Incomplete Utterance Restoration
Mengzuo Huang; Feng Li; Wuhe Zou; Weidong Zhang

Abstract
Dialogue systems in open domain have achieved great success due to the easily obtained single-turn corpus and the development of deep learning, but the multi-turn scenario is still a challenge because of the frequent coreference and information omission. In this paper, we investigate the incomplete utterance restoration which has brought general improvement over multi-turn dialogue systems in recent studies. Meanwhile, jointly inspired by the autoregression for text generation and the sequence labeling for text editing, we propose a novel semi autoregressive generator (SARG) with the high efficiency and flexibility. Moreover, experiments on two benchmarks show that our proposed model significantly outperforms the state-of-the-art models in terms of quality and inference speed.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| dialogue-rewriting-on-canard | SARG | BLEU: 54.80 |
| dialogue-rewriting-on-multi-rewrite | SARG (n_beam=5) | Rewriting F2: 52.5 Rewriting F3: 46.4 |
| dialogue-rewriting-on-multi-rewrite | SARG (greedy) | BLEU-1: 92.2 BLEU-2: 89.6 ROUGE-1: 92.1 ROUGE-2: 86.0 Rewriting F1: 62.4 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.