HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

One-shot action recognition in challenging therapy scenarios

Sabater Alberto ; Santos Laura ; Santos-Victor Jose ; Bernardino Alexandre ; Montesano Luis ; Murillo Ana C.

One-shot action recognition in challenging therapy scenarios

Abstract

One-shot action recognition aims to recognize new action categories from asingle reference example, typically referred to as the anchor example. Thiswork presents a novel approach for one-shot action recognition in the wild thatcomputes motion representations robust to variable kinematic conditions.One-shot action recognition is then performed by evaluating anchor and targetmotion representations. We also develop a set of complementary steps that boostthe action recognition performance in the most challenging scenarios. Ourapproach is evaluated on the public NTU-120 one-shot action recognitionbenchmark, outperforming previous action recognition models. Besides, weevaluate our framework on a real use-case of therapy with autistic people.These recordings are particularly challenging due to high-level artifacts fromthe patient motion. Our results provide not only quantitative but also onlinequalitative measures, essential for the patient evaluation and monitoringduring the actual therapy.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
one-shot-3d-action-recognition-on-ntu-rgbdTCN_OneShot
Accuracy: 46.5%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp