HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Scale-Prior Deformable Convolution for Exemplar-Guided Class-Agnostic Counting

{Antoni B. Chan Shuai Yi Jun Hou Shinan Liu Lingbo Liu Junyu Gao Xinzhu Ma Kunlin Yang Wei Lin}

Scale-Prior Deformable Convolution for Exemplar-Guided Class-Agnostic Counting

Abstract

Class-agnostic counting has recently emerged as a more practical counting task, which aims to predict the number and distribution of any exemplar objects, instead of counting specific categories like pedestrians or cars. However, recent methods are developed by designing suitable similarity matching rules between exemplars and query images, but ignoring the robustness of extracted features. To address this issue, we propose a scale-prior deformable convolution by integrating exemplars' information, eg, scale, into the counting network backbone. As a result, the proposed counting network can extract semantic features of objects similar to the given exemplars and effectively filter irrelevant backgrounds. Besides, we find that traditional L2 and generalized loss are not suitable for class-agnostic counting due to the variety of object scales in different samples. Here we propose a scale-sensitive generalized loss to tackle this problem. It can adjust the cost function formulation according to the given exemplars, making the difference between prediction and ground truth more prominent. Extensive experiments show that our model obtains remarkable improvement and achieves state-of-the-art performance on a public class-agnostic counting benchmark. the source code is available at https://github.com/Elin24/SPDCN-CAC.

Benchmarks

BenchmarkMethodologyMetrics
object-counting-on-fsc147SPDCN
MAE(test): 13.51
MAE(val): 14.59
RMSE(test): 96.80
RMSE(val): 49.97

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp