HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Rethinking on Multi-Stage Networks for Human Pose Estimation

Wenbo Li; Zhicheng Wang; Binyi Yin; Qixiang Peng; Yuming Du; Tianzi Xiao; Gang Yu; Hongtao Lu; Yichen Wei; Jian Sun

Rethinking on Multi-Stage Networks for Human Pose Estimation

Abstract

Existing pose estimation approaches fall into two categories: single-stage and multi-stage methods. While multi-stage methods are seemingly more suited for the task, their performance in current practice is not as good as single-stage methods. This work studies this issue. We argue that the current multi-stage methods' unsatisfactory performance comes from the insufficiency in various design choices. We propose several improvements, including the single-stage module design, cross stage feature aggregation, and coarse-to-fine supervision. The resulting method establishes the new state-of-the-art on both MS COCO and MPII Human Pose dataset, justifying the effectiveness of a multi-stage architecture. The source code is publicly available for further research.

Code Repositories

chenyilun95/tf-cpn
tf
Mentioned in GitHub
fenglinglwb/MSPN
pytorch
Mentioned in GitHub
hyperionfalling/lightpose
pytorch
Mentioned in GitHub
megvii-detection/MSPN
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
keypoint-detection-on-cocoMSPN(384x288)
Test AP: 76.1
keypoint-detection-on-coco-test-challengeMSPN+*
AP: 76.4
AP50: 92.9
AP75: 82.6
APL: 88.6
AR: 82.2
AR50: 96
AR75: 87.7
ARL: 83.2
ARM: 77.5
keypoint-detection-on-coco-test-devMSPN
AP: 76.1
AP50: 93.4
AP75: 83.8
APL: 81.5
APM: 72.3
AR: 81.6
AR50: 96.3
AR75: 88.1
ARL: 87.1
ARM: 77.5
pose-estimation-on-coco-minivalMSPN
AP: 75.9
pose-estimation-on-coco-test-devMSPN
AP: 76.1
AP50: 93.4
AP75: 83.8
APL: 81.5
APM: 72.3
AR: 81.6
pose-estimation-on-mpii-human-poseMSPN
PCKh-0.5: 92.6

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp