Command Palette
Search for a command to run...
An Alternative to WSSS? An Empirical Study of the Segment Anything Model (SAM) on Weakly-Supervised Semantic Segmentation Problems
Weixuan Sun Zheyuan Liu Yanhao Zhang Yiran Zhong Nick Barnes

Abstract
The Segment Anything Model (SAM) has demonstrated exceptional performance and versatility, making it a promising tool for various related tasks. In this report, we explore the application of SAM in Weakly-Supervised Semantic Segmentation (WSSS). Particularly, we adapt SAM as the pseudo-label generation pipeline given only the image-level class labels. While we observed impressive results in most cases, we also identify certain limitations. Our study includes performance evaluations on PASCAL VOC and MS-COCO, where we achieved remarkable improvements over the latest state-of-the-art methods on both datasets. We anticipate that this report encourages further explorations of adopting SAM in WSSS, as well as wider real-world applications.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| weakly-supervised-semantic-segmentation-on | WSSS-SAM(ResNet-101, multi-stage) | Mean IoU: 77.2 |
| weakly-supervised-semantic-segmentation-on-1 | WSSS-SAM(DeepLabV2-ResNet101) | Mean IoU: 77.1 |
| weakly-supervised-semantic-segmentation-on-4 | WSSS-SAM(DeepLabV2-ResNet101) | mIoU: 55.6 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.