An Impartial Transformer for Story Visualization

9 Jan 2023  ·  Nikolaos Tsakas, Maria Lymperaiou, Giorgos Filandrianos, Giorgos Stamou ·

Story Visualization is an advanced task of computed vision that targets sequential image synthesis, where the generated samples need to be realistic, faithful to their conditioning and sequentially consistent. Our work proposes a novel architectural and training approach: the Impartial Transformer achieves both text-relevant plausible scenes and sequential consistency utilizing as few trainable parameters as possible. This enhancement is even able to handle synthesis of 'hard' samples with occluded objects, achieving improved evaluation metrics comparing to past approaches.

PDF Abstract

Datasets


  Add Datasets introduced or used in this paper

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Story Visualization CLEVR-SV Impartial Transformer LPIPS 0.21 # 1

Methods