Command Palette
Search for a command to run...
The GIST and RIST of Iterative Self-Training for Semi-Supervised Segmentation
Eu Wern Teh Terrance DeVries Brendan Duke Ruowei Jiang Parham Aarabi Graham W. Taylor

Abstract
We consider the task of semi-supervised semantic segmentation, where we aim to produce pixel-wise semantic object masks given only a small number of human-labeled training examples. We focus on iterative self-training methods in which we explore the behavior of self-training over multiple refinement stages. We show that iterative self-training leads to performance degradation if done naïvely with a fixed ratio of human-labeled to pseudo-labeled training examples. We propose Greedy Iterative Self-Training (GIST) and Random Iterative Self-Training (RIST) strategies that alternate between training on either human-labeled data or pseudo-labeled data at each refinement stage, resulting in a performance boost rather than degradation. We further show that GIST and RIST can be combined with existing semi-supervised learning methods to boost performance.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| semi-supervised-semantic-segmentation-on-1 | GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained) | Validation mIoU: 65.14% |
| semi-supervised-semantic-segmentation-on-18 | GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained) | Validation mIoU: 53.51% |
| semi-supervised-semantic-segmentation-on-19 | GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained) | Validation mIoU: 59.98% |
| semi-supervised-semantic-segmentation-on-2 | GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained) | Validation mIoU: 62.57% |
| semi-supervised-semantic-segmentation-on-3 | GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained) | Validation mIoU: 58.70% |
| semi-supervised-semantic-segmentation-on-4 | GIST and RIST | Validation mIoU: 70.76% |
| semi-supervised-semantic-segmentation-on-5 | GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained) | Validation mIoU: 69.40% |
| semi-supervised-semantic-segmentation-on-6 | GIST and RIST (DeepLabv2 with ResNet101, MSCOCO pre-trained) | Validation mIoU: 67.21% |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.