HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement

Yongqing Liang Xin Li Navid Jafari Qin Chen

Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement

Abstract

We propose a new matching-based framework for semi-supervised video object segmentation (VOS). Recently, state-of-the-art VOS performance has been achieved by matching-based algorithms, in which feature banks are created to store features for region matching and classification. However, how to effectively organize information in the continuously growing feature bank remains under-explored, and this leads to inefficient design of the bank. We introduce an adaptive feature bank update scheme to dynamically absorb new features and discard obsolete features. We also design a new confidence loss and a fine-grained segmentation module to enhance the segmentation accuracy in uncertain regions. On public benchmarks, our algorithm outperforms existing state-of-the-arts.

Code Repositories

xmlyqing00/AFB-URR
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
semi-supervised-video-object-segmentation-on-13AFB-URR
F: 84.5
J: 82.9
Ju0026F: 83.7
semi-supervised-video-object-segmentation-on-14AFB-URR
F: 84.6
J: 82.9
Ju0026F: 83.8
semi-supervised-video-object-segmentation-on-20AFB-URR
D17 val (F): 76.1
D17 val (G): 74.6
D17 val (J): 73.0
FPS: 4.00
video-object-segmentation-on-youtube-vosAFB-URR
F-Measure (Seen): 83.1
F-Measure (Unseen): 82.6
Jaccard (Seen): 78.8
Jaccard (Unseen): 74.1
Overall: 79.6
visual-object-tracking-on-davis-2017AFB-URR
F-measure (Decay): 15.5
F-measure (Mean): 76.1
F-measure (Recall): 87.0
Ju0026F: 74.6
Jaccard (Decay): 13.8
Jaccard (Mean): 73.0
Jaccard (Recall): 85.3

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp