Search Results for author: James Kwok

Found 25 papers, 7 papers with code

Implicit Concept Removal of Diffusion Models

no code implementations9 Oct 2023 Zhili Liu, Kai Chen, Yifan Zhang, Jianhua Han, Lanqing Hong, Hang Xu, Zhenguo Li, Dit-yan Yeung, James Kwok

To address this, we utilize the intrinsic geometric characteristics of implicit concepts and present the Geom-Erasing, a novel concept removal method based on geometric-driven control.

PixArt-$α$: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis

2 code implementations30 Sep 2023 Junsong Chen, Jincheng Yu, Chongjian Ge, Lewei Yao, Enze Xie, Yue Wu, Zhongdao Wang, James Kwok, Ping Luo, Huchuan Lu, Zhenguo Li

We hope PIXART-$\alpha$ will provide new insights to the AIGC community and startups to accelerate building their own high-quality yet low-cost generative models from scratch.

Image Generation Language Modelling

Non-autoregressive Conditional Diffusion Models for Time Series Prediction

no code implementations8 Jun 2023 Lifeng Shen, James Kwok

In this paper, we propose TimeDiff, a non-autoregressive diffusion model that achieves high-quality time series prediction with the introduction of two novel conditioning mechanisms: future mixup and autoregressive initialization.

Denoising Open-Ended Question Answering +2

Nonparametric Iterative Machine Teaching

1 code implementation5 Jun 2023 Chen Zhang, Xiaofeng Cao, Weiyang Liu, Ivor Tsang, James Kwok

In this paper, we consider the problem of Iterative Machine Teaching (IMT), where the teacher provides examples to the learner iteratively such that the learner can achieve fast convergence to a target model.

An Adaptive Policy to Employ Sharpness-Aware Minimization

no code implementations28 Apr 2023 Weisen Jiang, Hansi Yang, Yu Zhang, James Kwok

Sharpness-aware minimization (SAM), which searches for flat minima by min-max optimization, has been shown to be useful in improving model generalization.

Leveraging per Image-Token Consistency for Vision-Language Pre-training

no code implementations CVPR 2023 Yunhao Gou, Tom Ko, Hansi Yang, James Kwok, Yu Zhang, Mingxuan Wang

(2) Under-utilization of the unmasked tokens: CMLM primarily focuses on the masked token but it cannot simultaneously leverage other tokens to learn vision-language associations.

Language Modelling Masked Language Modeling +1

Low-rank Tensor Learning with Nonconvex Overlapped Nuclear Norm Regularization

no code implementations6 May 2022 Quanming Yao, Yaqing Wang, Bo Han, James Kwok

While the optimization problem is nonconvex and nonsmooth, we show that its critical points still have good statistical performance on the tensor completion problem.

Effective Meta-Regularization by Kernelized Proximal Regularization

no code implementations NeurIPS 2021 Weisen Jiang, James Kwok, Yu Zhang

We study the problem of meta-learning, which has proved to be advantageous to accelerate learning new tasks with a few samples.

Meta-Learning

Multi-Subspace Structured Meta-Learning

no code implementations29 Sep 2021 Weisen Jiang, James Kwok, Yu Zhang

We propose a MUlti-Subspace structured Meta-Learning (MUSML) algorithm to learn the subspace bases.

Meta-Learning

Fast Deterministic Stackelberg Actor-Critic

no code implementations29 Sep 2021 Runsheng Yu, Xinrun Wang, James Kwok

Most advanced Actor-Critic (AC) approaches update the actor and critic concurrently through (stochastic) Gradient Descents (GD), which may be trapped into bad local optimality due to the instability of these simultaneous updating schemes.

Improving Meta-Continual Learning Representations with Representation Replay

no code implementations29 Sep 2021 Lawrence Ki-On Chan, James Kwok

In this paper, we remove this inconsistency in the use of ER and improve continual learning representations by integrating ER also into meta-training.

Continual Learning Meta-Learning

Normalization Helps Training of Quantized LSTM

1 code implementation NeurIPS 2019 Lu Hou, Jinhua Zhu, James Kwok, Fei Gao, Tao Qin, Tie-Yan Liu

The long-short-term memory (LSTM), though powerful, is memory and computa\x02tion expensive.

Quantization

Policy Tree Network

no code implementations25 Sep 2019 Zac Wellmer, Sepanta Zeighami, James Kwok

However, decision-time planning with implicit dynamics models in continuous action space has proven to be a difficult problem.

Model-based Reinforcement Learning Policy Gradient Methods +3

Policy Prediction Network: Model-Free Behavior Policy with Model-Based Learning in Continuous Action Space

no code implementations15 Sep 2019 Zac Wellmer, James Kwok

This paper proposes a novel deep reinforcement learning architecture that was inspired by previous tree structured architectures which were only useable in discrete action spaces.

Continuous Control Model-based Reinforcement Learning +2

Efficient Neural Interaction Function Search for Collaborative Filtering

2 code implementations28 Jun 2019 Quanming Yao, Xiangning Chen, James Kwok, Yong Li, Cho-Jui Hsieh

Motivated by the recent success of automated machine learning (AutoML), we propose in this paper the search for simple neural interaction functions (SIF) in CF.

AutoML Collaborative Filtering

Efficient Low-Rank Semidefinite Programming with Robust Loss Functions

no code implementations12 May 2019 Quanming Yao, Hangsi Yang, En-Liang Hu, James Kwok

In real-world applications, it is important for machine learning algorithms to be robust against data outliers or corruptions.

BIG-bench Machine Learning

Generalizing from a Few Examples: A Survey on Few-Shot Learning

4 code implementations10 Apr 2019 Yaqing Wang, Quanming Yao, James Kwok, Lionel M. Ni

Machine learning has been highly successful in data-intensive applications but is often hampered when the data set is small.

BIG-bench Machine Learning Few-Shot Learning

Side Information Fusion for Recommender Systems over Heterogeneous Information Network

1 code implementation8 Jan 2018 Huan Zhao, Quanming Yao, Yangqiu Song, James Kwok, Dik Lun Lee

Collaborative filtering (CF) has been one of the most important and popular recommendation methods, which aims at predicting users' preferences (ratings) based on their past behaviors.

Collaborative Filtering Recommendation Systems

Fast Second Order Stochastic Backpropagation for Variational Inference

no code implementations NeurIPS 2015 Kai Fan, Ziteng Wang, Jeff Beck, James Kwok, Katherine A. Heller

We propose a second-order (Hessian or Hessian-free) based optimization method for variational inference inspired by Gaussian backpropagation, and argue that quasi-Newton optimization can be developed as well.

regression Variational Inference

Fast Second-Order Stochastic Backpropagation for Variational Inference

no code implementations9 Sep 2015 Kai Fan, Ziteng Wang, Jeff Beck, James Kwok, Katherine Heller

We propose a second-order (Hessian or Hessian-free) based optimization method for variational inference inspired by Gaussian backpropagation, and argue that quasi-Newton optimization can be developed as well.

regression Variational Inference

Cannot find the paper you are looking for? You can Submit a new open access paper.