Command Palette
Search for a command to run...
Object Counting and Instance Segmentation with Image-level Supervision
Cholakkal Hisham ; Sun Guolei ; Khan Fahad Shahbaz ; Shao Ling

Abstract
Common object counting in a natural scene is a challenging problem incomputer vision with numerous real-world applications. Existing image-levelsupervised common object counting approaches only predict the global objectcount and rely on additional instance-level supervision to also determineobject locations. We propose an image-level supervised approach that providesboth the global object count and the spatial distribution of object instancesby constructing an object category density map. Motivated by psychologicalstudies, we further reduce image-level supervision using a limited object countinformation (up to four). To the best of our knowledge, we are the first topropose image-level supervised density map estimation for common objectcounting and demonstrate its effectiveness in image-level supervised instancesegmentation. Comprehensive experiments are performed on the PASCAL VOC andCOCO datasets. Our approach outperforms existing methods, including those usinginstance-level supervision, on both datasets for common object counting.Moreover, our approach improves state-of-the-art image-level supervisedinstance segmentation with a relative gain of 17.8% in terms of average bestoverlap, on the PASCAL VOC 2012 dataset. Code link:https://github.com/GuoleiSun/CountSeg
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| object-counting-on-coco-count-test | Supervised Density Map | m-reIRMSE: 0.18 m-reIRMSE-nz: 0.84 mRMSE: 0.34 mRMSE-nz: 1.89 |
| object-counting-on-pascal-voc | ILC | mRMSE: 0.29 |
| object-counting-on-pascal-voc-2007-count-test | Supervised Density Map | m-reIRMSE-nz: 0.61 m-relRMSE: 0.17 mRMSE: 0.29 mRMSE-nz: 1.14 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.