Command Palette
Search for a command to run...
CutPaste: Self-Supervised Learning for Anomaly Detection and Localization
Chun-Liang Li Kihyuk Sohn Jinsung Yoon Tomas Pfister

Abstract
We aim at constructing a high performance model for defect detection that detects unknown anomalous patterns of an image without anomalous data. To this end, we propose a two-stage framework for building anomaly detectors using normal training data only. We first learn self-supervised deep representations and then build a generative one-class classifier on learned representations. We learn representations by classifying normal data from the CutPaste, a simple data augmentation strategy that cuts an image patch and pastes at a random location of a large image. Our empirical study on MVTec anomaly detection dataset demonstrates the proposed algorithm is general to be able to detect various types of real-world defects. We bring the improvement upon previous arts by 3.1 AUCs when learning representations from scratch. By transfer learning on pretrained representations on ImageNet, we achieve a new state-of-theart 96.6 AUC. Lastly, we extend the framework to learn and extract representations from patches to allow localizing defective areas without annotations during training.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| anomaly-classification-on-goodsad | CutPaste | AUPR: 62.8 AUROC: 60.2 |
| anomaly-detection-on-mvtec-ad | CutPaste (Patch level detector) | Segmentation AUROC: 96.0 |
| anomaly-detection-on-mvtec-ad | CutPaste (Image level detector) | Detection AUROC: 95.2 Segmentation AUROC: 88.3 |
| anomaly-detection-on-mvtec-ad | CutPaste (ensemble) | Detection AUROC: 96.1 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.