Search Results for author: Linglong Kong

Found 22 papers, 6 papers with code

Gaussian Differential Privacy on Riemannian Manifolds

1 code implementation NeurIPS 2023 Yangdi Jiang, Xiaotian Chang, Yi Liu, Lei Ding, Linglong Kong, Bei Jiang

We develop an advanced approach for extending Gaussian Differential Privacy (GDP) to general Riemannian manifolds.

Mathematical Challenges in Deep Learning

no code implementations24 Mar 2023 Vahid Partovi Nia, Guojun Zhang, Ivan Kobyzev, Michael R. Metel, Xinlin Li, Ke Sun, Sobhan Hemati, Masoud Asgharian, Linglong Kong, Wulong Liu, Boxing Chen

Deep models are dominating the artificial intelligence (AI) industry since the ImageNet challenge in 2012.

Conformalized Fairness via Quantile Regression

1 code implementation5 Oct 2022 Meichen Liu, Lei Ding, Dengdeng Yu, Wulong Liu, Linglong Kong, Bei Jiang

To fulfill great needs and advocate the significance of quantile fairness, we propose a novel framework to learn a real-valued quantile function under the fairness requirement of Demographic Parity with respect to sensitive attributes, such as race or gender, and thereby derive a reliable fair prediction interval.

Conformal Prediction Fairness +2

How Does Value Distribution in Distributional Reinforcement Learning Help Optimization?

no code implementations29 Sep 2022 Ke Sun, Bei Jiang, Linglong Kong

We consider the problem of learning a set of probability distributions from the Bellman dynamics in distributional reinforcement learning~(RL) that learns the whole return distribution compared with only its expectation in classical RL.

Distributional Reinforcement Learning reinforcement-learning +1

Distributional Reinforcement Learning by Sinkhorn Divergence

no code implementations1 Feb 2022 Ke Sun, Yingnan Zhao, Wulong Liu, Bei Jiang, Linglong Kong

The empirical success of distributional reinforcement learning~(RL) highly depends on the distribution representation and the choice of distribution divergence.

Atari Games Distributional Reinforcement Learning +2

Word Embeddings via Causal Inference: Gender Bias Reducing and Semantic Information Preserving

1 code implementation9 Dec 2021 Lei Ding, Dengdeng Yu, Jinhan Xie, Wenxing Guo, Shenggang Hu, Meichen Liu, Linglong Kong, Hongsheng Dai, Yanchun Bao, Bei Jiang

The proposed method allows us to construct and analyze the complex causal mechanisms facilitating gender information flow while retaining oracle semantic information within word embeddings.

Causal Inference Word Embeddings +1

Damped Anderson Mixing for Deep Reinforcement Learning: Acceleration, Convergence, and Stabilization

no code implementations NeurIPS 2021 Ke Sun, Yafei Wang, Yi Liu, Yingnan Zhao, Bo Pan, Shangling Jui, Bei Jiang, Linglong Kong

Anderson mixing has been heuristically applied to reinforcement learning (RL) algorithms for accelerating convergence and improving the sampling efficiency of deep RL.

reinforcement-learning Reinforcement Learning (RL)

TAG: Toward Accurate Social Media Content Tagging with a Concept Graph

no code implementations13 Oct 2021 Jiuding Yang, Weidong Guo, Bang Liu, Yakun Yu, Chaoyue Wang, Jinwen Luo, Linglong Kong, Di Niu, Zhen Wen

Although conceptualization has been widely studied in semantics and knowledge representation, it is still challenging to find the most accurate concept phrases to characterize the main idea of a text snippet on the fast-growing social media.

Dependency Parsing Graph Matching +4

The Benefits of Being Categorical Distributional: Uncertainty-aware Regularized Exploration in Reinforcement Learning

no code implementations7 Oct 2021 Ke Sun, Yingnan Zhao, Enze Shi, Yafei Wang, Xiaodong Yan, Bei Jiang, Linglong Kong

The theoretical advantages of distributional reinforcement learning~(RL) over classical RL remain elusive despite its remarkable empirical performance.

Atari Games Attribute +3

Towards Understanding Distributional Reinforcement Learning: Regularization, Optimization, Acceleration and Sinkhorn Algorithm

no code implementations29 Sep 2021 Ke Sun, Yingnan Zhao, Yi Liu, Enze Shi, Yafei Wang, Aref Sadeghi, Xiaodong Yan, Bei Jiang, Linglong Kong

Distributional reinforcement learning~(RL) is a class of state-of-the-art algorithms that estimate the whole distribution of the total return rather than only its expectation.

Atari Games Distributional Reinforcement Learning +2

Exploring the Robustness of Distributional Reinforcement Learning against Noisy State Observations

no code implementations29 Sep 2021 Ke Sun, Yi Liu, Yingnan Zhao, Hengshuai Yao, Shangling Jui, Linglong Kong

In real scenarios, state observations that an agent observes may contain measurement errors or adversarial noises, misleading the agent to take suboptimal actions or even collapse while training.

Distributional Reinforcement Learning reinforcement-learning +1

Gaussian Differential Privacy Transformation: from identification to application

no code implementations29 Sep 2021 Yi Liu, Ke Sun, Bei Jiang, Linglong Kong

Gaussian differential privacy (GDP) is a single-parameter family of privacy notions that provides coherent guarantees to avoid the exposure of individuals from machine learning models.

L$^{2}$NAS: Learning to Optimize Neural Architectures via Continuous-Action Reinforcement Learning

no code implementations25 Sep 2021 Keith G. Mills, Fred X. Han, Mohammad Salameh, SEYED SAEED CHANGIZ REZAEI, Linglong Kong, Wei Lu, Shuo Lian, Shangling Jui, Di Niu

In this paper, we propose L$^{2}$NAS, which learns to intelligently optimize and update architecture hyperparameters via an actor neural network based on the distribution of high-performing architectures in the search history.

Hyperparameter Optimization Neural Architecture Search +2

A Simple Unified Framework for Anomaly Detection in Deep Reinforcement Learning

no code implementations21 Sep 2021 Hongming Zhang, Ke Sun, Bo Xu, Linglong Kong, Martin Müller

In this paper, we propose a simple yet effective anomaly detection framework for deep RL algorithms that simultaneously considers random, adversarial and out-of-distribution~(OOD) state outliers.

Anomaly Detection Atari Games +3

Exploring the Training Robustness of Distributional Reinforcement Learning against Noisy State Observations

1 code implementation17 Sep 2021 Ke Sun, Yingnan Zhao, Shangling Jui, Linglong Kong

In real scenarios, state observations that an agent observes may contain measurement errors or adversarial noises, misleading the agent to take suboptimal actions or even collapse while training.

Density Estimation Distributional Reinforcement Learning +2

Learning Privately over Distributed Features: An ADMM Sharing Approach

no code implementations17 Jul 2019 Yaochen Hu, Peng Liu, Linglong Kong, Di Niu

Distributed machine learning has been widely studied in order to handle exploding amount of data.

Distributional Reinforcement Learning for Efficient Exploration

no code implementations13 May 2019 Borislav Mavrin, Shangtong Zhang, Hengshuai Yao, Linglong Kong, Kaiwen Wu, Yao-Liang Yu

In distributional reinforcement learning (RL), the estimated distribution of value function models both the parametric and intrinsic uncertainties.

Atari Games Distributional Reinforcement Learning +3

Deep Reinforcement Learning with Decorrelation

no code implementations18 Mar 2019 Borislav Mavrin, Hengshuai Yao, Linglong Kong

Further experiments on the losing games show that our decorelation algorithms can win over DQN and QR-DQN with a fined tuned regularization factor.

Atari Games reinforcement-learning +2

QUOTA: The Quantile Option Architecture for Reinforcement Learning

3 code implementations5 Nov 2018 Shangtong Zhang, Borislav Mavrin, Linglong Kong, Bo Liu, Hengshuai Yao

In this paper, we propose the Quantile Option Architecture (QUOTA) for exploration based on recent advances in distributional reinforcement learning (RL).

Decision Making Distributional Reinforcement Learning +2

Growing Story Forest Online from Massive Breaking News

1 code implementation1 Mar 2018 Bang Liu, Di Niu, Kunfeng Lai, Linglong Kong, Yu Xu

We describe our experience of implementing a news content organization system at Tencent that discovers events from vast streams of breaking news and evolves news story structures in an online fashion.

Graph Generation Information Threading

Expectile Matrix Factorization for Skewed Data Analysis

no code implementations7 Jun 2016 Rui Zhu, Di Niu, Linglong Kong, Zongpeng Li

Matrix factorization is a popular approach to solving matrix estimation problems based on partial observations.

Local Region Sparse Learning for Image-on-Scalar Regression

no code implementations27 May 2016 Yao Chen, Xiao Wang, Linglong Kong, Hongtu Zhu

Identification of regions of interest (ROI) associated with certain disease has a great impact on public health.

regression Sparse Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.