HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Specifying Object Attributes and Relations in Interactive Scene Generation

Ashual Oron ; Wolf Lior

Specifying Object Attributes and Relations in Interactive Scene
  Generation

Abstract

We introduce a method for the generation of images from an input scene graph.The method separates between a layout embedding and an appearance embedding.The dual embedding leads to generated images that better match the scene graph,have higher visual quality, and support more complex scene graphs. In addition,the embedding scheme supports multiple and diverse output images per scenegraph, which can be further controlled by the user. We demonstrate two modes ofper-object control: (i) importing elements from other images, and (ii)navigation in the object space, by selecting an appearance archetype. Our codeis publicly available at https://www.github.com/ashual/scene_generation

Code Repositories

Touyuki/Cover_generation
pytorch
Mentioned in GitHub
ashual/scene_generation
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
layout-to-image-generation-on-coco-stuff-2SOARISG
FID: 48.7
Inception Score: 10.3
layout-to-image-generation-on-coco-stuff-3SOARISG
FID: 59.5
Inception Score: 12.5
SceneFID: 33.46

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp