Command Palette
Search for a command to run...
Hayate Iso; Chao Qiao; Hang Li

Abstract
We propose a novel text editing task, referred to as \textit{fact-based text editing}, in which the goal is to revise a given document to better describe the facts in a knowledge base (e.g., several triples). The task is important in practice because reflecting the truth is a common requirement in text editing. First, we propose a method for automatically generating a dataset for research on fact-based text editing, where each instance consists of a draft text, a revised text, and several facts represented in triples. We apply the method into two public table-to-text datasets, obtaining two new datasets consisting of 233k and 37k instances, respectively. Next, we propose a new neural network architecture for fact-based text editing, called \textsc{FactEditor}, which edits a draft text by referring to given facts using a buffer, a stream, and a memory. A straightforward approach to address the problem would be to employ an encoder-decoder model. Our experimental results on the two datasets show that \textsc{FactEditor} outperforms the encoder-decoder approach in terms of fidelity and fluency. The results also show that \textsc{FactEditor} conducts inference faster than the encoder-decoder approach.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| fact-based-text-editing-on-rotoedit | FactEditor | ADD: 41.5 BLEU: 84.43 DELETE: 84.24 Exact Match: 2.65 F1: 63.39 KEEP: 98.41 Precision: 78.84 Recall: 52.3 SARI: 74.72 |
| fact-based-text-editing-on-webedit | Table-to-Text | ADD: 27.86 BLEU: 33.75 DELETE: 0.5219 Exact Match: 5.78 F1: 90.4 KEEP: 0.5144 Precision: 98.23 Recall: 83.72 SARI: 43.83 |
| fact-based-text-editing-on-webedit | No-Editing | ADD: 3.91 BLEU: 66.67 DELETE: 0.1202 Exact Match: 0 F1: 80.21 KEEP: 0.7862 Precision: 84.49 Recall: 76.34 SARI: 31.51 |
| fact-based-text-editing-on-webedit | Text-to-Text | ADD: 25.77 BLEU: 63.61 DELETE: 0.678 Exact Match: 6.22 F1: 79.48 KEEP: 0.8262 Precision: 81.93 Recall: 77.16 SARI: 58.73 |
| fact-based-text-editing-on-webedit | FactEditor | ADD: 47.69 BLEU: 75.68 DELETE: 0.7707 Exact Match: 24.8 F1: 93.17 KEEP: 0.9184 Precision: 96.88 Recall: 89.74 SARI: 72.2 |
| fact-based-text-editing-on-webedit | EncDecEditor | ADD: 43.82 BLEU: 71.03 DELETE: 0.7548 Exact Match: 20.96 F1: 92.51 KEEP: 0.8949 Precision: 98.06 Recall: 87.56 SARI: 69.59 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.