HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Object Counting and Instance Segmentation with Image-level Supervision

Cholakkal Hisham ; Sun Guolei ; Khan Fahad Shahbaz ; Shao Ling

Object Counting and Instance Segmentation with Image-level Supervision

Abstract

Common object counting in a natural scene is a challenging problem incomputer vision with numerous real-world applications. Existing image-levelsupervised common object counting approaches only predict the global objectcount and rely on additional instance-level supervision to also determineobject locations. We propose an image-level supervised approach that providesboth the global object count and the spatial distribution of object instancesby constructing an object category density map. Motivated by psychologicalstudies, we further reduce image-level supervision using a limited object countinformation (up to four). To the best of our knowledge, we are the first topropose image-level supervised density map estimation for common objectcounting and demonstrate its effectiveness in image-level supervised instancesegmentation. Comprehensive experiments are performed on the PASCAL VOC andCOCO datasets. Our approach outperforms existing methods, including those usinginstance-level supervision, on both datasets for common object counting.Moreover, our approach improves state-of-the-art image-level supervisedinstance segmentation with a relative gain of 17.8% in terms of average bestoverlap, on the PASCAL VOC 2012 dataset. Code link:https://github.com/GuoleiSun/CountSeg

Code Repositories

GuoleiSun/CountSeg
Official
pytorch
Mentioned in GitHub
alzayats/CountSeg-1
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
object-counting-on-coco-count-testSupervised Density Map
m-reIRMSE: 0.18
m-reIRMSE-nz: 0.84
mRMSE: 0.34
mRMSE-nz: 1.89
object-counting-on-pascal-vocILC
mRMSE: 0.29
object-counting-on-pascal-voc-2007-count-testSupervised Density Map
m-reIRMSE-nz: 0.61
m-relRMSE: 0.17
mRMSE: 0.29
mRMSE-nz: 1.14

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp