HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Comparative study of models trained on synthetic data for Ukrainian grammatical error correction

{Andrii Fedorych Andrii Shportko Artem Yushko Maksym Bondarenko}

Comparative study of models trained on synthetic data for Ukrainian grammatical error correction

Abstract

The task of Grammatical Error Correction (GEC) has been extensively studied for the English language. However, its application to low-resource languages, such as Ukrainian, remains an open challenge. In this paper, we develop sequence tagging and neural machine translation models for the Ukrainian language as well as a set of algorithmic correction rules to augment those systems. We also develop synthetic data generation techniques for the Ukrainian language to create high-quality human-like errors. Finally, we determine the best combination of synthetically generated data to augment the existing UA-GEC corpus and achieve the state-of-the-art results of 0.663 F0. 5 score on the newly established UA-GEC benchmark. The code and trained models will be made publicly available on GitHub and HuggingFace.

Benchmarks

BenchmarkMethodologyMetrics
grammatical-error-correction-on-ua-gecmBART-based model with synthetic data
F0.5: 68.17

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Comparative study of models trained on synthetic data for Ukrainian grammatical error correction | Papers | HyperAI