Methods > General > Regularization

R1 Regularization

Introduced by Mescheder et al. in Which Training Methods for GANs do actually Converge?

R$_{1}$ Regularization is a regularization technique and gradient penalty for training generative adversarial networks. It penalizes the discriminator from deviating from the Nash Equilibrium via penalizing the gradient on real data alone: when the generator distribution produces the true data distribution and the discriminator is equal to 0 on the data manifold, the gradient penalty ensures that the discriminator cannot create a non-zero gradient orthogonal to the data manifold without suffering a loss in the GAN game.

This leads to the following regularization term:

$$ R_{1}\left(\psi\right) = \frac{\gamma}{2}E_{p_{D}\left(x\right)}\left[||\nabla{D_{\psi}\left(x\right)}||^{2}\right] $$

Source: Which Training Methods for GANs do actually Converge?

Latest Papers

PAPER DATE
A Simple Baseline for StyleGAN Inversion
| Tianyi WeiDongdong ChenWenbo ZhouJing LiaoWeiming ZhangLu YuanGang HuaNenghai Yu
2021-04-15
Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalization
Daiqing LiJunlin YangKarsten KreisAntonio TorralbaSanja Fidler
2021-04-12
MobileStyleGAN: A Lightweight Convolutional Neural Network for High-Fidelity Image Synthesis
| Sergei Belousov
2021-04-10
Content-Aware GAN Compression
Yuchen LiuZhixin ShuYijun LiZhe LinFederico PerazziS. Y. Kung
2021-04-06
On the Applicability of Synthetic Data for Face Recognition
Haoyu ZhangMarcel GrimmerRaghavendra RamachandraKiran RajaChristoph Busch
2021-04-06
StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery
| Or PatashnikZongze WuEli ShechtmanDaniel Cohen-OrDani Lischinski
2021-03-31
Multi-Class Multi-Instance Count Conditioned Adversarial Image Generation
Amrutha SaseendranKathrin SkubchMargret Keuper
2021-03-31
Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translation
Gihyun KwonJong Chul Ye
2021-03-30
Unsupervised Disentanglement of Linear-Encoded Facial Semantics
Yutong ZhengYu-Kai HuangRan TaoZhiqiang ShenMarios Savvides
2021-03-30
Labels4Free: Unsupervised Segmentation using StyleGAN
Rameen AbdalPeihao ZhuNiloy MitraPeter Wonka
2021-03-27
Few-shot Semantic Image Synthesis Using StyleGAN Prior
Yuki EndoYoshihiro Kanamori
2021-03-27
Matched sample selection with GANs for mitigating attribute confounding
| Chandan SinghGuha BalakrishnanPietro Perona
2021-03-24
PhotoApp: Photorealistic Appearance Editing of Head Portraits
Mallikarjun B RAyush TewariAbdallah DibTim WeyrichBernd BickelHans-Peter SeidelHanspeter PfisterWojciech MatusikLouis ChevallierMohamed ElgharibChristian Theobalt
2021-03-13
Style-based Point Generator with Adversarial Rendering for Point Cloud Completion
| Chulin XieChuxin WangBo ZhangHao YangDong ChenFang Wen
2021-03-03
Generative Adversarial Transformers
| Drew A. HudsonC. Lawrence Zitnick
2021-03-01
Systematic Analysis and Removal of Circular Artifacts for StyleGAN
Way TanBihan WenXulei Yang
2021-03-01
Do Generative Models Know Disentanglement? Contrastive Learning is All You Need
| Xuanchi RenTao YangYuwang WangWenjun Zeng
2021-02-21
SWAGAN: A Style-based Wavelet-driven Generative Model
| Rinon GalDana CohenAmit BermanoDaniel Cohen-Or
2021-02-11
TräumerAI: Dreaming Music with StyleGAN
| Dasaem JeongSeungheon DohTaegyun Kwon
2021-02-09
Designing an Encoder for StyleGAN Image Manipulation
| Omer TovYuval AlalufYotam NitzanOr PatashnikDaniel Cohen-Or
2021-02-04
Only a Matter of Style: Age Transformation Using a Style-Based Regression Model
| Yuval AlalufOr PatashnikDaniel Cohen-Or
2021-02-04
Generating images from caption and vice versa via CLIP-Guided Generative Latent Space Search
| Federico A. GalatoloMario G. C. A. CiminoGigliola Vaglini
2021-02-02
Using StyleGAN for Visual Interpretability of Deep Learning Models on Medical Images
Kathryn SchutteOlivier MoindrotPaul HérentJean-Baptiste SchirattiSimon Jégou
2021-01-19
GAN Inversion: A Survey
| Weihao XiaYulun ZhangYujiu YangJing-Hao XueBolei ZhouMing-Hsuan Yang
2021-01-14
Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesis
| Bingchen LiuYizhe ZhuKunpeng SongAhmed Elgammal
2021-01-12
VOGUE: Try-On by StyleGAN Interpolation Optimization
| Kathleen M LewisSrivatsan VaradharajanIra Kemelmacher-Shlizerman
2021-01-06
Focal Frequency Loss for Image Reconstruction and Synthesis
| Liming JiangBo DaiWayne WuChen Change Loy
2020-12-23
Time-Travel Rephotography
Xuan LuoXuaner ZhangPaul YooRicardo Martin-BruallaJason LawrenceSteven M. Seitz
2020-12-22
GuidedStyle: Attribute Knowledge Guided Style Manipulation for Semantic Face Editing
Xianxu HouXiaokang ZhangLinlin ShenZhihui LaiJun Wan
2020-12-22
Improved StyleGAN Embedding: Where are the Good Latents?
Peihao ZhuRameen AbdalYipeng QinJohn FemianiPeter Wonka
2020-12-13
This Face Does Not Exist ... But It Might Be Yours! Identity Leakage in Generative Models
Patrick TinsleyAdam CzajkaPatrick Flynn
2020-12-10
Positional Encoding as Spatial Inductive Bias in GANs
Rui XuXintao WangKai ChenBolei ZhouChen Change Loy
2020-12-09
Vulnerability Analysis of Face Morphing Attacks from Landmarks and Generative Adversarial Networks
| Eklavya SarkarPavel KorshunovLaurent ColboisSébastien Marcel
2020-12-09
Bayesian Image Reconstruction using Deep Generative Models
| Razvan V MarinescuDaniel MoyerPolina Golland
2020-12-08
TediGAN: Text-Guided Diverse Face Image Generation and Manipulation
| Weihao XiaYujiu YangJing-Hao XueBaoyuan Wu
2020-12-06
MPG: A Multi-ingredient Pizza Image Generator with Conditional StyleGANs
Fangda HanGuoyao HaoRicardo GuerreroVladimir Pavlovic
2020-12-04
GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolution
Kelvin C. K. ChanXintao WangXiangyu XuJinwei GuChen Change Loy
2020-12-01
Navigating the GAN Parameter Space for Semantic Image Editing
| Anton CherepkovAndrey VoynovArtem Babenko
2020-11-27
Lifting 2D StyleGAN for 3D-Aware Face Generation
Yichun ShiDivyansh AggarwalAnil K. Jain
2020-11-26
StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation
| Zongze WuDani LischinskiEli Shechtman
2020-11-25
HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms
| Mahmoud AfifiMarcus A. BrubakerMichael S. Brown
2020-11-23
Disentangling Latent Space for Unsupervised Semantic Face Editing
| Kanglin LiuGaofeng CaoFei ZhouBozhi LiuJiang DuanGuoping Qiu
2020-11-05
Transforming Facial Weight of Real Images by Editing Latent Space of StyleGAN
| V N S Rama Krishna PinnimtyMatt ZhaoPalakorn AchananuparpEe-Peng Lim
2020-11-05
One Model to Reconstruct Them All: A Novel Way to Use the Stochastic Noise in StyleGAN
| Christian BartzJoseph BethgeHaojin YangChristoph Meinel
2020-10-21
Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Network
| Jialu HuangJing LiaoSam Kwong
2020-10-12
Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domains
| Justin N. M. PinkneyDoron Adler
2020-10-11
MammoGANesis: Controlled Generation of High-Resolution Mammograms for Radiology Education
| Cyril ZakkaGhida SahebElie NajemGhina Berjawi
2020-10-11
MaterialGAN: Reflectance Capture using a Generative SVBRDF Model
Yu GuoCameron SmithMiloš HašanKalyan SunkavalliShuang Zhao
2020-09-30
PIE: Portrait Image Embedding for Semantic Control
Ayush TewariMohamed ElgharibMallikarjun B R.Florian BernardHans-Peter SeidelPatrick PérezMichael ZollhöferChristian Theobalt
2020-09-20
MIPGAN -- Generating Strong and High Quality Morphing Attacks Using Identity Prior Driven GAN
Haoyu ZhangSushma VenkateshRaghavendra RamachandraKiran RajaNaser DamerChristoph Busch
2020-09-03
Text and Style Conditioned GAN for Generation of Offline Handwriting Lines
| Brian DavisChris TensmeyerBrian PriceCurtis WigingtonBryan MorseRajiv Jain
2020-09-01
GIF: Generative Interpretable Faces
| Partha GhoshPravir Singh GuptaRoy UzielAnurag RanjanMichael BlackTimo Bolkart
2020-08-31
DeepLandscape: Adversarial Modeling of Landscape Video
| Elizaveta LogachevaRoman SuvorovOleg KhomenkoAnton MashikhinVictor Lempitsky
2020-08-21
Improving the Performance of Fine-Grain Image Classifiers via Generative Data Augmentation
Shashank ManjunathAitzaz NathanielJeff DruceStan German
2020-08-12
StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows
| Rameen AbdalPeihao ZhuNiloy MitraPeter Wonka
2020-08-06
Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation
| Elad RichardsonYuval AlalufOr PatashnikYotam NitzanYaniv AzarStav ShapiroDaniel Cohen-Or
2020-08-03
DeepLandscape: Adversarial Modeling of Landscape Videos
| Elizaveta LogachevaRoman SuvorovOleg KhomenkoAnton MashikhinVictor Lempitsky
2020-08-01
Detection, Attribution and Localization of GAN Generated Images
Michael GoebelLakshmanan NatarajTejaswi NanjundaswamyTajuddin Manhar MohammedShivkumar ChandrasekaranB. S. Manjunath
2020-07-20
Generative Hierarchical Features from Synthesizing Images
| Yinghao XuYujun ShenJiapeng ZhuCeyuan YangBolei Zhou
2020-07-20
Can GAN Generated Morphs Threaten Face Recognition Systems Equally as Landmark Based Morphs? -- Vulnerability and Detection
Sushma VenkateshHaoyu ZhangRaghavendra RamachandraKiran RajaNaser DamerChristoph Busch
2020-07-07
A Free Viewpoint Portrait Generator with Dynamic Styling
| Anpei ChenRuiyang LiuLing XieJingyi Yu
2020-07-07
Collaborative Learning for Faster StyleGAN Embedding
Shanyan GuanYing TaiBingbing NiFeida ZhuFeiyue HuangXiaokang Yang
2020-07-03
PriorGAN: Real Data Prior for Generative Adversarial Nets
| Shuyang GuJianmin BaoDong ChenFang Wen
2020-06-30
High Resolution Zero-Shot Domain Adaptation of Synthetically Rendered Face Images
Stephan J. GarbinMarek KowalskiMatthew JohnsonJamie Shotton
2020-06-26
Differentiable Augmentation for Data-Efficient GAN Training
| Shengyu ZhaoZhijian LiuJi LinJun-Yan ZhuSong Han
2020-06-18
Generating Master Faces for Use in Performing Wolf Attacks on Face Recognition Systems
Huy H. NguyenJunichi YamagishiIsao EchizenSébastien Marcel
2020-06-15
Training Generative Adversarial Networks with Limited Data
| Tero KarrasMiika AittalaJanne HellstenSamuli LaineJaakko LehtinenTimo Aila
2020-06-11
Least $k$th-Order and Rényi Generative Adversarial Networks
Himesh BhatiaWilliam PaulFady AlajajiBahman GharesifardPhilippe Burlina
2020-06-03
Using Generative Models for Pediatric wbMRI
Alex ChangVinith M. SuriyakumarAbhishek MoturuNipaporn TewattanaratAndrea DoriaAnna Goldenberg
2020-06-01
Network Bending: Expressive Manipulation of Deep Generative Models
| Terence BroadFrederic Fol LeymarieMick Grierson
2020-05-25
Recognizing Families through Images with Pretrained Encoder
Tuan-Duy H. NguyenHuu-Nghia H. NguyenHieu Dao
2020-05-24
Face Identity Disentanglement via Latent Space Mapping
| Yotam NitzanAmit BermanoYangyan LiDaniel Cohen-Or
2020-05-15
Editing in Style: Uncovering the Local Semantics of GANs
| Edo CollinsRaja BalaBob PriceSabine Süsstrunk
2020-04-29
Adversarial Latent Autoencoders
| Stanislav PidhorskyiDonald AdjerohGianfranco Doretto
2020-04-09
Feature Quantization Improves GAN Training
| Yang ZhaoChunyuan LiPing YuJianfeng GaoChangyou Chen
2020-04-05
StyleRig: Rigging StyleGAN for 3D Control over Portrait Images
Ayush TewariMohamed ElgharibGaurav BharajFlorian BernardHans-Peter SeidelPatrick PérezMichael ZollhöferChristian Theobalt
2020-03-31
One-Shot Domain Adaptation For Face Generation
Chao YangSer-Nam Lim
2020-03-28
Re-Training StyleGAN -- A First Step Towards Building Large, Scalable Synthetic Facial Datasets
Viktor VarkarakisShabab BazrafkanPeter Corcoran
2020-03-24
Perceptual Image Super-Resolution with Progressive Adversarial Network
Lone WongDeli ZhaoShaohua WanBo Zhang
2020-03-08
StyleGAN2 Distillation for Feed-forward Image Manipulation
| Yuri ViazovetskyiVladimir IvashkinEvgeny Kashin
2020-03-07
Semi-Supervised StyleGAN for Disentanglement Learning
Weili NieTero KarrasAnimesh GargShoubhik DebnathAnjul PatneyAnkit B. PatelAnima Anandkumar
2020-03-06
Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANs
| Sangwoo MoMinsu ChoJinwoo Shin
2020-02-25
HRFA: High-Resolution Feature-based Attack
| Zhixing YeSizhe ChenPeidong ZhangChengjin SunXiaolin Huang
2020-01-21
Unsupervised multi-modal Styled Content Generation
Omry SendikDani LischinskiDaniel Cohen-Or
2020-01-10
CNN-generated images are surprisingly easy to spot... for now
| Sheng-Yu WangOliver WangRichard ZhangAndrew OwensAlexei A. Efros
2019-12-23
Unconstrained Facial Expression Transfer using Style-based Generator
| Chao YangSer-Nam Lim
2019-12-12
Achieving Robustness in the Wild via Adversarial Mixing with Disentangled Representations
Sven GowalChongli QinPo-Sen HuangTaylan CemgilKrishnamurthy DvijothamTimothy MannPushmeet Kohli
2019-12-06
Analyzing and Improving the Image Quality of StyleGAN
| Tero KarrasSamuli LaineMiika AittalaJanne HellstenJaakko LehtinenTimo Aila
2019-12-03
Detecting GAN generated errors
Xiru ZhuFengdi CheTianzi YangTzuyang YuDavid MegerGregory Dudek
2019-12-02
Semantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesis
| Ceyuan YangYujun ShenBolei Zhou
2019-11-21
Unsupervised Projection Networks for Generative Adversarial Networks
Daiyaan ArfeenJesse Zhang
2019-09-30
RGBD-GAN: Unsupervised 3D Representation Learning From Natural Image Datasets via RGBD Image Synthesis
| Atsuhiro NoguchiTatsuya Harada
2019-09-27
LoGANv2: Conditional Style-Based Logo Generation with Generative Adversarial Networks
| Cedric OeldorfGerasimos Spanakis
2019-09-22
Generating High-Resolution Fashion Model Images Wearing Custom Outfits
Gökhan YildirimNikolay JetchevRoland VollgrafUrs Bergmann
2019-08-23
Image Synthesis From Reconfigurable Layout and Style
| Wei SunTianfu Wu
2019-08-20
Emergence of Object Segmentation in Perturbed Generative Models
| Adam BielskiPaolo Favaro
2019-05-29
Improved Precision and Recall Metric for Assessing Generative Models
| Tuomas KynkäänniemiTero KarrasSamuli LaineJaakko LehtinenTimo Aila
2019-04-15
Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?
| Rameen AbdalYipeng QinPeter Wonka
2019-04-05
A Style-Based Generator Architecture for Generative Adversarial Networks
| Tero KarrasSamuli LaineTimo Aila
2018-12-12
Which Training Methods for GANs do actually Converge?
| Lars MeschederAndreas GeigerSebastian Nowozin
2018-01-13

Components

COMPONENT TYPE
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories