Command Palette
Search for a command to run...
Pushing the Envelope for Depth-Based Semi-Supervised 3D Hand Pose Estimation with Consistency Training
Mohammad Rezaei Farnaz Farahanipad Alex Dillhoff Vassilis Athitsos

Abstract
Despite the significant progress that depth-based 3D hand pose estimation methods have made in recent years, they still require a large amount of labeled training data to achieve high accuracy. However, collecting such data is both costly and time-consuming. To tackle this issue, we propose a semi-supervised method to significantly reduce the dependence on labeled training data. The proposed method consists of two identical networks trained jointly: a teacher network and a student network. The teacher network is trained using both the available labeled and unlabeled samples. It leverages the unlabeled samples via a loss formulation that encourages estimation equivariance under a set of affine transformations. The student network is trained using the unlabeled samples with their pseudo-labels provided by the teacher network. For inference at test time, only the student network is used. Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art semi-supervised methods by large margins.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| hand-pose-estimation-on-icvl-hands | Teacher-Student | Average 3D Error: 5.99 |
| hand-pose-estimation-on-msra-hands | Teacher-Student | Average 3D Error: 7.18 |
| hand-pose-estimation-on-nyu-hands | Teacher-Student | Average 3D Error: 8.01 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.