HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

3D Human Pose Estimation in RGBD Images for Robotic Task Learning

Christian Zimmermann; Tim Welschehold; Christian Dornhege; Wolfram Burgard; Thomas Brox

3D Human Pose Estimation in RGBD Images for Robotic Task Learning

Abstract

We propose an approach to estimate 3D human pose in real world units from a single RGBD image and show that it exceeds performance of monocular 3D pose estimation approaches from color as well as pose estimation exclusively from depth. Our approach builds on robust human keypoint detectors for color images and incorporates depth for lifting into 3D. We combine the system with our learning from demonstration framework to instruct a service robot without the need of markers. Experiments in real world settings demonstrate that our approach enables a PR2 robot to imitate manipulation actions observed from a human teacher.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
3d-human-pose-estimation-on-total-captureROS node wrapping
Average MPJPE (mm): 112

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp