Search Results for author: Mingyuan Fan

Found 19 papers, 5 papers with code

Music Consistency Models

no code implementations20 Apr 2024 Zhengcong Fei, Mingyuan Fan, Junshi Huang

Consistency models have exhibited remarkable capabilities in facilitating efficient image/video generation, enabling synthesis with minimal sampling steps.

Computational Efficiency Music Generation +1

Scalable Diffusion Models with State Space Backbone

1 code implementation8 Feb 2024 Zhengcong Fei, Mingyuan Fan, Changqian Yu, Junshi Huang

We endeavor to train diffusion models for image data, wherein the traditional U-Net backbone is supplanted by a state space backbone, functioning on raw patches or latent space.

Conditional Image Generation

Tuning-Free Inversion-Enhanced Control for Consistent Image Editing

no code implementations22 Dec 2023 Xiaoyue Duan, Shuhao Cui, Guoliang Kang, Baochang Zhang, Zhengcong Fei, Mingyuan Fan, Junshi Huang

Consistent editing of real images is a challenging task, as it requires performing non-rigid edits (e. g., changing postures) to the main objects in the input image without changing their identity or attributes.

Denoising

A-JEPA: Joint-Embedding Predictive Architecture Can Listen

no code implementations27 Nov 2023 Zhengcong Fei, Mingyuan Fan, Junshi Huang

The target representations of those regions are extracted by the exponential moving average of context encoder, \emph{i. e.}, target encoder, on the whole spectrogram.

Self-Supervised Learning

Flatness-aware Adversarial Attack

no code implementations10 Nov 2023 Mingyuan Fan, Xiaodan Li, Cen Chen, Yinggui Wang

We reveal that input regularization based methods make resultant adversarial examples biased towards flat extreme regions.

Adversarial Attack

On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook

no code implementations31 Jul 2023 Mingyuan Fan, Chengyu Wang, Cen Chen, Yang Liu, Jun Huang

Diffusion models and large language models have emerged as leading-edge generative models, revolutionizing various aspects of human life.

Fairness

On the Robustness of Split Learning against Adversarial Attacks

no code implementations16 Jul 2023 Mingyuan Fan, Cen Chen, Chengyu Wang, Wenmeng Zhou, Jun Huang

Split learning enables collaborative deep learning model training while preserving data privacy and model security by avoiding direct sharing of raw data and model details (i. e., sever and clients only hold partial sub-networks and exchange intermediate computations).

Adversarial Attack

Gradient-Free Textual Inversion

no code implementations12 Apr 2023 Zhengcong Fei, Mingyuan Fan, Junshi Huang

Recent works on personalized text-to-image generation usually learn to bind a special token with specific subjects or styles of a few given images by tuning its embedding through gradient descent.

Computational Efficiency Dimensionality Reduction +1

Masked Auto-Encoders Meet Generative Adversarial Networks and Beyond

1 code implementation CVPR 2023 Zhengcong Fei, Mingyuan Fan, Li Zhu, Junshi Huang, Xiaoming Wei, Xiaolin Wei

In this paper, we introduce a novel Generative Adversarial Networks alike framework, referred to as GAN-MAE, where a generator is used to generate the masked patches according to the remaining visible patches, and a discriminator is employed to predict whether the patch is synthesized by the generator.

Representation Learning

Refiner: Data Refining against Gradient Leakage Attacks in Federated Learning

no code implementations5 Dec 2022 Mingyuan Fan, Cen Chen, Chengyu Wang, Xiaodan Li, Wenmeng Zhou, Jun Huang

Recent works have brought attention to the vulnerability of Federated Learning (FL) systems to gradient leakage attacks.

Federated Learning Semantic Similarity +1

Uncertainty-Aware Image Captioning

no code implementations30 Nov 2022 Zhengcong Fei, Mingyuan Fan, Li Zhu, Junshi Huang, Xiaoming Wei, Xiaolin Wei

It is well believed that the higher uncertainty in a word of the caption, the more inter-correlated context information is required to determine it.

Caption Generation Image Captioning +1

Progressive Text-to-Image Generation

no code implementations5 Oct 2022 Zhengcong Fei, Mingyuan Fan, Li Zhu, Junshi Huang

Recently, Vector Quantized AutoRegressive (VQ-AR) models have shown remarkable results in text-to-image synthesis by equally predicting discrete image tokens from the top left to bottom right in the latent space.

Denoising Text-to-Image Generation

MaskBlock: Transferable Adversarial Examples with Bayes Approach

1 code implementation13 Aug 2022 Mingyuan Fan, Cen Chen, Ximeng Liu, Wenzhong Guo

By contrast, we re-formulate crafting transferable AEs as the maximizing a posteriori probability estimation problem, which is an effective approach to boost the generalization of results with limited available data.

Defense against Backdoor Attacks via Identifying and Purifying Bad Neurons

no code implementations13 Aug 2022 Mingyuan Fan, Yang Liu, Cen Chen, Ximeng Liu, Wenzhong Guo

The opacity of neural networks leads their vulnerability to backdoor attacks, where hidden attention of infected neurons is triggered to override normal predictions to the attacker-chosen ones.

backdoor defense

Case-Aware Adversarial Training

no code implementations20 Apr 2022 Mingyuan Fan, Yang Liu, Cen Chen

Specifically, the intuition stems from the fact that a very limited part of informative samples can contribute to most of model performance.

Enhance transferability of adversarial examples with model architecture

no code implementations28 Feb 2022 Mingyuan Fan, Wenzhong Guo, Shengxing Yu, Zuobin Ying, Ximeng Liu

Transferability of adversarial examples is of critical importance to launch black-box adversarial attacks, where attackers are only allowed to access the output of the target model.

Backdoor Defense with Machine Unlearning

no code implementations24 Jan 2022 Yang Liu, Mingyuan Fan, Cen Chen, Ximeng Liu, Zhuo Ma, Li Wang, Jianfeng Ma

First, trigger pattern recovery is conducted to extract the trigger patterns infected by the victim model.

backdoor defense Machine Unlearning

Cannot find the paper you are looking for? You can Submit a new open access paper.