HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Where are the Blobs: Counting by Localization with Point Supervision

Issam H. Laradji; Negar Rostamzadeh; Pedro O. Pinheiro; David Vazquez; Mark Schmidt

Where are the Blobs: Counting by Localization with Point Supervision

Abstract

Object counting is an important task in computer vision due to its growing demand in applications such as surveillance, traffic monitoring, and counting everyday objects. State-of-the-art methods use regression-based optimization where they explicitly learn to count the objects of interest. These often perform better than detection-based methods that need to learn the more difficult task of predicting the location, size, and shape of each object. However, we propose a detection-based method that does not need to estimate the size and shape of the objects and that outperforms regression-based methods. Our contributions are three-fold: (1) we propose a novel loss function that encourages the network to output a single blob per object instance using point-level annotations only; (2) we design two methods for splitting large predicted blobs between object instances; and (3) we show that our method achieves new state-of-the-art results on several challenging datasets including the Pascal VOC and the Penguins dataset. Our method even outperforms those that use stronger supervision such as depth features, multi-point annotations, and bounding-box labels.

Code Repositories

ElementAI/LCFCN
pytorch
Mentioned in GitHub
andohuman/RebarCounting
pytorch
Mentioned in GitHub
CJLee94/Point-Supervised-Segmentation
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
object-counting-on-coco-count-testLC-ResFCN
m-reIRMSE: 0.19
m-reIRMSE-nz: 0.99
mRMSE: 0.38
mRMSE-nz: 2.20
object-counting-on-pascal-voc-2007-count-testLC-ResFCN
m-reIRMSE-nz: 0.61
m-relRMSE: 0.17
mRMSE: 0.31
mRMSE-nz: 1.20
object-counting-on-pascal-voc-2007-count-testLC-PSPNet
m-reIRMSE-nz: 0.70
m-relRMSE: 0.20
mRMSE: 0.35
mRMSE-nz: 1.32

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp