HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

LSA-T: The first continuous Argentinian Sign Language dataset for Sign Language Translation

Pedro Dal Bianco Gastón Ríos Franco Ronchetti Facundo Quiroga Oscar Stanchi Waldo Hasperué Alejandro Rosete

LSA-T: The first continuous Argentinian Sign Language dataset for Sign Language Translation

Abstract

Sign language translation (SLT) is an active field of study that encompasses human-computer interaction, computer vision, natural language processing and machine learning. Progress on this field could lead to higher levels of integration of deaf people. This paper presents, to the best of our knowledge, the first continuous Argentinian Sign Language (LSA) dataset. It contains 14,880 sentence level videos of LSA extracted from the CN Sordos YouTube channel with labels and keypoints annotations for each signer. We also present a method for inferring the active signer, a detailed analysis of the characteristics of the dataset, a visualization tool to explore the dataset and a neural SLT model to serve as baseline for future experiments.

Code Repositories

midusi/lsa-t
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
sign-language-translation-on-lsa-tKeypoints-Transformer-UNLP
Word Error Rate (WER): 0.9392

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp