Generative Adversarial Transformer

GANformer is a novel and efficient type of transformer which can be used for visual generative modeling. The network employs a bipartite structure that enables long-range interactions across an image, while maintaining computation of linearly efficiency, that can readily scale to high-resolution synthesis. It iteratively propagates information from a set of latent variables to the evolving visual features and vice versa, to support the refinement of each in light of the other and encourage the emergence of compositional representations of objects and scenes.

Source: Generative Adversarial Transformers

Image source: Generative Adversarial Transformers