Conditional Image Generation

133 papers with code • 10 benchmarks • 8 datasets

Conditional image generation is the task of generating new images from a dataset conditional on their class.

( Image credit: PixelCNN++ )

Libraries

Use these libraries to find Conditional Image Generation models and implementations

Latest papers with no code

SyncDiffusion: Coherent Montage via Synchronized Joint Diffusions

no code yet • NeurIPS 2023

Specifically, we compute the gradient of the perceptual loss using the predicted denoised images at each denoising step, providing meaningful guidance for achieving coherent montages.

Cocktail: Mixing Multi-Modality Controls for Text-Conditional Image Generation

no code yet • 1 Jun 2023

In this work, we propose Cocktail, a pipeline to mix various modalities into one embedding, amalgamated with a generalized ControlNet (gControlNet), a controllable normalisation (ControlNorm), and a spatial guidance sampling method, to actualize multi-modal and spatially-refined control for text-conditional diffusion models.

DuDGAN: Improving Class-Conditional GANs via Dual-Diffusion

no code yet • 24 May 2023

We evaluated our method using the AFHQ, Food-101, and CIFAR-10 datasets and observed superior results across metrics such as FID, KID, Precision, and Recall score compared with comparison models, highlighting the effectiveness of our approach.

Unified Multi-Modal Latent Diffusion for Joint Subject and Text Conditional Image Generation

no code yet • 16 Mar 2023

Language-guided image generation has achieved great success nowadays by using diffusion models.

Collage Diffusion

no code yet • 1 Mar 2023

We seek to give users precise control over diffusion-based image generation by modeling complex scenes as sequences of layers, which define the desired spatial arrangement and visual attributes of objects in the scene.

CDPMSR: Conditional Diffusion Probabilistic Models for Single Image Super-Resolution

no code yet • 14 Feb 2023

Diffusion probabilistic models (DPM) have been widely adopted in image-to-image translation to generate high-quality images.

Exploring Intra-Class Variation Factors With Learnable Cluster Prompts for Semi-Supervised Image Synthesis

no code yet • CVPR 2023

Semi-supervised class-conditional image synthesis is typically performed by inferring and injecting class labels into a conditional Generative Adversarial Network (GAN).

Zero-Shot Object Segmentation through Concept Distillation from Generative Image Foundation Models

no code yet • 29 Dec 2022

Curating datasets for object segmentation is a difficult task.

Rethinking the Objectives of Vector-Quantized Tokenizers for Image Synthesis

no code yet • 6 Dec 2022

Vector-Quantized (VQ-based) generative models usually consist of two basic components, i. e., VQ tokenizers and generative transformers.

A survey on knowledge-enhanced multimodal learning

no code yet • 19 Nov 2022

Multimodal learning has been a field of increasing interest, aiming to combine various modalities in a single joint representation.