Text-to-Image Generation
276 papers with code • 11 benchmarks • 18 datasets
Text-to-Image Generation is a task in computer vision and natural language processing where the goal is to generate an image that corresponds to a given textual description. This involves converting the text input into a meaningful representation, such as a feature vector, and then using this representation to generate an image that matches the description.
Benchmarks
These leaderboards are used to track progress in Text-to-Image Generation
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
Libraries
Use these libraries to find Text-to-Image Generation models and implementationsDatasets
MS COCO
CUB-200-2011
Oxford 102 Flower
Conceptual Captions
Fashion-Gen
Multi-Modal CelebA-HQ
LHQ
Pick-a-Pic
T2I-CompBench
Human-Art
Subtasks
Latest papers
SDXS: Real-Time One-Step Latent Diffusion Models with Image Conditions
IDKiro/sdxs
•
•
Recent advancements in diffusion models have positioned them at the forefront of image generation.
RL for Consistency Models: Faster Reward Guided Text-to-Image Generation
To overcome this limitation, consistency models proposed learning a new class of generative models that directly map noise to data, resulting in a model that can generate an image in as few as one sampling iteration.
Long-CLIP: Unlocking the Long-Text Capability of CLIP
Contrastive Language-Image Pre-training (CLIP) has been the cornerstone for zero-shot classification, text-image retrieval, and text-image generation by aligning image and text modalities.
CLIP-VQDiffusion : Langauge Free Training of Text To Image generation using CLIP and vector quantized diffusion model
infiniq-ai1/clipvqdiffusion
•
•
There has been a significant progress in text conditional image generation models.
Open-Vocabulary Attention Maps with Token Optimization for Semantic Segmentation in Diffusion Models
vpulab/ovam
•
•
This approach limits the generation of segmentation masks derived from word tokens not contained in the text prompt.
FouriScale: A Frequency Perspective on Training-Free High-Resolution Image Synthesis
In this study, we delve into the generation of high-resolution images from pre-trained diffusion models, addressing persistent challenges, such as repetitive patterns and structural distortions, that emerge when models are applied beyond their trained resolutions.
OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Models
kongzhecn/omg
•
•
We also observe that the initiation denoising timestep for noise blending is the key to identity preservation and layout.
StreamMultiDiffusion: Real-Time Interactive Generation with Region-Based Semantic Control
ironjr/streammultidiffusion
•
•
The enormous success of diffusion models in text-to-image synthesis has made them promising candidates for the next generation of end-user applications for image generation and editing.
Bridging Different Language Models and Generative Vision Models for Text-to-Image Generation
In this paper, we explore this objective and propose LaVi-Bridge, a pipeline that enables the integration of diverse pre-trained language models and generative vision models for text-to-image generation.
FaceChain-SuDe: Building Derived Class to Inherit Category Attributes for One-shot Subject-Driven Generation
In this paper, motivated by object-oriented programming, we model the subject as a derived class whose base class is its semantic category.
