Command Palette
Search for a command to run...
Specifying Object Attributes and Relations in Interactive Scene Generation
Ashual Oron ; Wolf Lior

Abstract
We introduce a method for the generation of images from an input scene graph.The method separates between a layout embedding and an appearance embedding.The dual embedding leads to generated images that better match the scene graph,have higher visual quality, and support more complex scene graphs. In addition,the embedding scheme supports multiple and diverse output images per scenegraph, which can be further controlled by the user. We demonstrate two modes ofper-object control: (i) importing elements from other images, and (ii)navigation in the object space, by selecting an appearance archetype. Our codeis publicly available at https://www.github.com/ashual/scene_generation
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| layout-to-image-generation-on-coco-stuff-2 | SOARISG | FID: 48.7 Inception Score: 10.3 |
| layout-to-image-generation-on-coco-stuff-3 | SOARISG | FID: 59.5 Inception Score: 12.5 SceneFID: 33.46 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.