HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Near Human-Level Performance in Grammatical Error Correction with Hybrid Machine Translation

Roman Grundkiewicz; Marcin Junczys-Dowmunt

Near Human-Level Performance in Grammatical Error Correction with Hybrid Machine Translation

Abstract

We combine two of the most popular approaches to automated Grammatical Error Correction (GEC): GEC based on Statistical Machine Translation (SMT) and GEC based on Neural Machine Translation (NMT). The hybrid system achieves new state-of-the-art results on the CoNLL-2014 and JFLEG benchmarks. This GEC system preserves the accuracy of SMT output and, at the same time, generates more fluent sentences as it typical for NMT. Our analysis shows that the created systems are closer to reaching human-level performance than any other GEC system reported so far.

Benchmarks

BenchmarkMethodologyMetrics
grammatical-error-correction-on-conll-2014SMT + BiGRU
F0.5: 56.25
grammatical-error-correction-on-conll-2014-1SMT + BiGRU
F0.5: 72.04
grammatical-error-correction-on-jflegSMT + BiGRU
GLEU: 61.5

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Near Human-Level Performance in Grammatical Error Correction with Hybrid Machine Translation | Papers | HyperAI