Search Results for author: Weidong Liu

Found 26 papers, 5 papers with code

A Short Review for Ontology Learning from Text: Stride from Shallow Learning, Deep Learning to Large Language Models Trend

no code implementations23 Apr 2024 Rick Du, Huilong An, Keyu Wang, Weidong Liu

It analyzes the methodologies and limitations of shallow-learning-based and deep-learning-based techniques for ontology learning, and provides comprehensive knowledge for the frontier work of using large language models to enhance ontology learning.

OneBit: Towards Extremely Low-bit Large Language Models

no code implementations17 Feb 2024 Yuzhuang Xu, Xu Han, Zonghan Yang, Shuo Wang, Qingfu Zhu, Zhiyuan Liu, Weidong Liu, Wanxiang Che

Model quantification uses low bit-width values to represent the weight matrices of models, which is a promising approach to reduce both storage and computational overheads of deploying highly anticipated LLMs.

Quantization

Efficient Sparse Least Absolute Deviation Regression with Differential Privacy

no code implementations2 Jan 2024 Weidong Liu, Xiaojun Mao, Xiaofei Zhang, Xin Zhang

To fast solve the non-smooth loss under a given privacy budget, we develop a Fast Robust And Privacy-Preserving Estimation (FRAPPE) algorithm for least absolute deviation regression.

Privacy Preserving regression

Vision-language Assisted Attribute Learning

no code implementations12 Dec 2023 Kongming Liang, Xinran Wang, Rui Wang, Donghui Gao, Ling Jin, Weidong Liu, Xiatian Zhu, Zhanyu Ma, Jun Guo

Attribute labeling at large scale is typically incomplete and partial, posing significant challenges to model optimization.

Attribute Language Modelling +2

Online Estimation and Inference for Robust Policy Evaluation in Reinforcement Learning

no code implementations4 Oct 2023 Weidong Liu, Jiyuan Tu, Yichen Zhang, Xi Chen

In this paper, we develop an online robust policy evaluation procedure, and establish the limiting distribution of our estimator, based on its Bahadur representation.

reinforcement-learning

Exploring Large Language Models for Communication Games: An Empirical Study on Werewolf

no code implementations9 Sep 2023 Yuzhuang Xu, Shuo Wang, Peng Li, Fuwen Luo, Xiaolong Wang, Weidong Liu, Yang Liu

Communication games, which we refer to as incomplete information games that heavily depend on natural language communication, hold significant research value in fields such as economics, social science, and artificial intelligence.

Retrieval

Pluggable Neural Machine Translation Models via Memory-augmented Adapters

1 code implementation12 Jul 2023 Yuzhuang Xu, Shuo Wang, Peng Li, Xuebo Liu, Xiaolong Wang, Weidong Liu, Yang Liu

Although neural machine translation (NMT) models perform well in the general domain, it remains rather challenging to control their generation behavior to satisfy the requirement of different users.

Machine Translation NMT +1

Distributed Semi-Supervised Sparse Statistical Inference

no code implementations17 Jun 2023 Jiyuan Tu, Weidong Liu, Xiaojun Mao, Mingyue Xu

The debiased estimator is a crucial tool in statistical inference for high-dimensional model parameters.

Acceleration of stochastic gradient descent with momentum by averaging: finite-sample rates and asymptotic normality

no code implementations28 May 2023 Kejie Tang, Weidong Liu, Yichen Zhang, Xi Chen

Stochastic gradient descent with momentum (SGDM) has been widely used in many machine learning and statistical applications.

Uncertainty Quantification

Super-Resolution Information Enhancement For Crowd Counting

1 code implementation13 Mar 2023 Jiahao Xie, Wei Xu, Dingkang Liang, Zhanyu Ma, Kongming Liang, Weidong Liu, Rui Wang, Ling Jin

As the proposed method requires SR labels, we further propose a Super-Resolution Crowd Counting dataset (SR-Crowd).

Crowd Counting Super-Resolution

Distributed Estimation and Inference for Semi-parametric Binary Response Models

no code implementations15 Oct 2022 Xi Chen, Wenbo Jing, Weidong Liu, Yichen Zhang

The development of modern technology has enabled data collection of unprecedented size, which poses new challenges to many statistical estimation and inference problems.

Distributed Computing

Fast and Robust Sparsity Learning over Networks: A Decentralized Surrogate Median Regression Approach

no code implementations11 Feb 2022 Weidong Liu, Xiaojun Mao, Xin Zhang

Decentralized sparsity learning has attracted a significant amount of attention recently due to its rapidly growing applications.

regression

Malicious Mode Attack on EV Coordinated Charging Load and MIADRC Defense Strategy

no code implementations26 Oct 2021 Yichen Zhou, Weidong Liu, Jing Ma, Xinghao Zhen, Yonggang Li

Further, to mitigate the impact of MMA, a defense strategy based on multi-index information active disturbance rejection control is proposed to improve the stability and anti-disturbance ability of the power system, which considers the impact factors of both mode damping and disturbance compensation.

Structured DropConnect for Uncertainty Inference in Image Classification

1 code implementation16 Jun 2021 Wenqing Zheng, Jiyang Xie, Weidong Liu, Zhanyu Ma

For image classification tasks, we propose a structured DropConnect (SDC) framework to model the output of a deep neural network by a Dirichlet distribution.

Classification Image Classification +1

Variance Reduced Median-of-Means Estimator for Byzantine-Robust Distributed Inference

no code implementations4 Mar 2021 Jiyuan Tu, Weidong Liu, Xiaojun Mao, Xi Chen

Based on the proposed VRMOM estimator, we develop a general distributed inference algorithm that is robust against Byzantine failures.

Computational Efficiency

Neural Interactive Collaborative Filtering

1 code implementation4 Jul 2020 Lixin Zou, Long Xia, Yulong Gu, Xiangyu Zhao, Weidong Liu, Jimmy Xiangji Huang, Dawei Yin

Therefore, the proposed exploration policy, to balance between learning the user profile and making accurate recommendations, can be directly optimized by maximizing users' long-term satisfaction with reinforcement learning.

Collaborative Filtering Meta-Learning +2

Median Matrix Completion: from Embarrassment to Optimality

no code implementations ICML 2020 Weidong Liu, Xiaojun Mao, Raymond K. W. Wong

In this paper, we consider matrix completion with absolute deviation loss and obtain an estimator of the median matrix.

Matrix Completion

Distributed High-dimensional Regression Under a Quantile Loss Function

no code implementations13 Jun 2019 Xi Chen, Weidong Liu, Xiaojun Mao, Zhuoyi Yang

This paper studies distributed estimation and support recovery for high-dimensional linear regression model with heavy-tailed noise.

regression Vocal Bursts Intensity Prediction

Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systems

no code implementations13 Feb 2019 Lixin Zou, Long Xia, Zhuoye Ding, Jiaxing Song, Weidong Liu, Dawei Yin

Though reinforcement learning~(RL) naturally fits the problem of maximizing the long term rewards, applying RL to optimize long-term user engagement is still facing challenges: user behaviors are versatile and difficult to model, which typically consists of both instant feedback~(e. g. clicks, ordering) and delayed feedback~(e. g. dwell time, revisit); in addition, performing effective off-policy learning is still immature, especially when combining bootstrapping and function approximation.

Recommendation Systems reinforcement-learning +1

Attention-aware Multi-stroke Style Transfer

1 code implementation CVPR 2019 Yuan Yao, Jianqiang Ren, Xuansong Xie, Weidong Liu, Yong-Jin Liu, Jun Wang

Neural style transfer has drawn considerable attention from both academic and industrial field.

Style Transfer

Distributed Inference for Linear Support Vector Machine

no code implementations29 Nov 2018 Xiaozhou Wang, Zhuoyi Yang, Xi Chen, Weidong Liu

In this paper, we propose a multi-round distributed linear-type (MDL) estimator for conducting inference for linear SVM.

Binary Classification

First-order Newton-type Estimator for Distributed Estimation and Inference

no code implementations28 Nov 2018 Xi Chen, Weidong Liu, Yichen Zhang

The key component in our method is the proposal of a computationally efficient estimator of $\Sigma^{-1} w$, where $\Sigma$ is the population Hessian matrix and $w$ is any given vector.

Vocal Bursts Type Prediction

Quantile Regression Under Memory Constraint

no code implementations18 Oct 2018 Xi Chen, Weidong Liu, Yichen Zhang

This paper proposes a computationally efficient method, which only requires an initial QR estimator on a small batch of data and then successively refines the estimator via multiple rounds of aggregations.

Distributed Computing regression

Fast and Adaptive Sparse Precision Matrix Estimation in High Dimensions

no code implementations17 Mar 2012 Weidong Liu, Xi Luo

We analyze an adaptive procedure based on cross validation, and establish its convergence rate under the Frobenius norm.

Vocal Bursts Intensity Prediction

Cannot find the paper you are looking for? You can Submit a new open access paper.