HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

An Impartial Transformer for Story Visualization

Nikolaos Tsakas; Maria Lymperaiou; Giorgos Filandrianos; Giorgos Stamou

An Impartial Transformer for Story Visualization

Abstract

Story Visualization is an advanced task of computed vision that targets sequential image synthesis, where the generated samples need to be realistic, faithful to their conditioning and sequentially consistent. Our work proposes a novel architectural and training approach: the Impartial Transformer achieves both text-relevant plausible scenes and sequential consistency utilizing as few trainable parameters as possible. This enhancement is even able to handle synthesis of 'hard' samples with occluded objects, achieving improved evaluation metrics comparing to past approaches.

Benchmarks

BenchmarkMethodologyMetrics
story-visualization-on-clevr-svImpartial Transformer
LPIPS: 0.21

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp