Search Results for author: Xinwei Zhang

Found 22 papers, 4 papers with code

Pre-training Differentially Private Models with Limited Public Data

no code implementations28 Feb 2024 Zhiqi Bu, Xinwei Zhang, Mingyi Hong, Sheng Zha, George Karypis

The superior performance of large foundation models relies on the use of massive amounts of high-quality data, which often contain sensitive, private and copyrighted material that requires formal protection.

Boundary Exploration for Bayesian Optimization With Unknown Physical Constraints

no code implementations12 Feb 2024 Yunsheng Tian, Ane Zuniga, Xinwei Zhang, Johannes P. Dürholt, Payel Das, Jie Chen, Wojciech Matusik, Mina Konaković Luković

In this paper, we observe that in such scenarios optimal solution typically lies on the boundary between feasible and infeasible regions of the design space, making it considerably more difficult than that with interior optima.

Bayesian Optimization Gaussian Processes

Differentially Private SGD Without Clipping Bias: An Error-Feedback Approach

no code implementations24 Nov 2023 Xinwei Zhang, Zhiqi Bu, Zhiwei Steven Wu, Mingyi Hong

In our work, we propose a new error-feedback (EF) DP algorithm as an alternative to DPSGD-GC, which not only offers a diminishing utility bound without inducing a constant clipping bias, but more importantly, it allows for an arbitrary choice of clipping threshold that is independent of the problem.

On semi-supervised estimation using exponential tilt mixture models

no code implementations14 Nov 2023 Ye Tian, Xinwei Zhang, Zhiqiang Tan

Consider a semi-supervised setting with a labeled dataset of binary responses and predictors and an unlabeled dataset with only the predictors.

regression

A new method using deep transfer learning on ECG to predict the response to cardiac resynchronization therapy

no code implementations2 Jun 2023 Zhuo He, Hongjin Si, Xinwei Zhang, Qing-Hui Chen, Jiangang Zou, Weihua Zhou

The model was fine-tuned to extract relevant features from the ECG images, and then tested on our dataset of CRT patients to predict their response.

Specificity Transfer Learning

Persistently Trained, Diffusion-assisted Energy-based Models

1 code implementation21 Apr 2023 Xinwei Zhang, Zhiqiang Tan, Zhijian Ou

Maximum likelihood (ML) learning for energy-based models (EBMs) is challenging, partly due to non-convergence of Markov chain Monte Carlo. Several variations of ML learning have been proposed, but existing methods all fail to achieve both post-training image generation and proper density estimation.

Density Estimation Image Generation +1

GLASU: A Communication-Efficient Algorithm for Federated Learning with Vertically Distributed Graph Data

no code implementations16 Mar 2023 Xinwei Zhang, Mingyi Hong, Jie Chen

In this paper, we propose a model splitting method that splits a backbone GNN across the clients and the server and a communication-efficient algorithm, GLASU, to train such a model.

Vertical Federated Learning

Enabling Deep Learning-based Physical-layer Secret Key Generation for FDD-OFDM Systems in Multi-Environments

no code implementations6 Nov 2022 Xinwei Zhang, Guyue Li, Junqing Zhang, Linning Peng, Aiqun Hu, Xianbin Wang

Deep learning-based physical-layer secret key generation (PKG) has been used to overcome the imperfect uplink/downlink channel reciprocity in frequency division duplexing (FDD) orthogonal frequency division multiplexing (OFDM) systems.

Meta-Learning Transfer Learning

Grow and Merge: A Unified Framework for Continuous Categories Discovery

no code implementations9 Oct 2022 Xinwei Zhang, Jianwen Jiang, Yutong Feng, Zhi-Fan Wu, Xibin Zhao, Hai Wan, Mingqian Tang, Rong Jin, Yue Gao

Although a number of studies are devoted to novel category discovery, most of them assume a static setting where both labeled and unlabeled data are given at once for finding new categories.

Self-Supervised Learning

Automatic Context Pattern Generation for Entity Set Expansion

1 code implementation17 Jul 2022 Yinghui Li, Shulin Huang, Xinwei Zhang, Qingyu Zhou, Yangning Li, Ruiyang Liu, Yunbo Cao, Hai-Tao Zheng, Ying Shen

In addition, we propose the GAPA, a novel ESE framework that leverages the aforementioned GenerAted PAtterns to expand target entities.

Information Retrieval Retrieval +1

Understanding A Class of Decentralized and Federated Optimization Algorithms: A Multi-Rate Feedback Control Perspective

no code implementations27 Apr 2022 Xinwei Zhang, Mingyi Hong, Nicola Elia

Distributed algorithms have been playing an increasingly important role in many applications such as machine learning, signal processing, and control.

Distributed Optimization

Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacy

no code implementations25 Jun 2021 Xinwei Zhang, Xiangyi Chen, Mingyi Hong, Zhiwei Steven Wu, JinFeng Yi

Recently, there has been a line of work on incorporating the formal privacy notion of differential privacy with FL.

Federated Learning

Hybrid Federated Learning: Algorithms and Implementation

no code implementations22 Dec 2020 Xinwei Zhang, Wotao Yin, Mingyi Hong, Tianyi Chen

To the best of our knowledge, this is the first formulation and algorithm developed for the hybrid FL.

Federated Learning

Privacy-Preserving Technology to Help Millions of People: Federated Prediction Model for Stroke Prevention

no code implementations15 Jun 2020 Ce Ju, Ruihui Zhao, Jichao Sun, Xiguang Wei, Bo Zhao, Yang Liu, Hongshan Li, Tianjian Chen, Xinwei Zhang, Dashan Gao, Ben Tan, Han Yu, Chuning He, Yuan Jin

It adopts federated averaging during the model training process, without patient data being taken out of the hospitals during the whole process of model training and forecasting.

Privacy Preserving

FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data

1 code implementation22 May 2020 Xinwei Zhang, Mingyi Hong, Sairaj Dhople, Wotao Yin, Yang Liu

Aiming at designing FL algorithms that are provably fast and require as few assumptions as possible, we propose a new algorithm design strategy from the primal-dual optimization perspective.

Federated Learning

Distributed Learning in the Non-Convex World: From Batch to Streaming Data, and Beyond

no code implementations14 Jan 2020 Tsung-Hui Chang, Mingyi Hong, Hoi-To Wai, Xinwei Zhang, Songtao Lu

In particular, we {provide a selective review} about the recent techniques developed for optimizing non-convex models (i. e., problem classes), processing batch and streaming data (i. e., data types), over the networks in a distributed manner (i. e., communication and computation paradigm).

A Communication Efficient Collaborative Learning Framework for Distributed Features

no code implementations24 Dec 2019 Yang Liu, Yan Kang, Xinwei Zhang, Liping Li, Yong Cheng, Tianjian Chen, Mingyi Hong, Qiang Yang

We introduce a collaborative learning framework allowing multiple parties having different sets of attributes about the same user to jointly build models without exposing their raw data or model parameters.

Semi-supervised Logistic Learning Based on Exponential Tilt Mixture Models

no code implementations19 Jun 2019 Xinwei Zhang, Zhiqiang Tan

Consider semi-supervised learning for classification, where both labeled and unlabeled data are available for training.

General Classification regression

Cannot find the paper you are looking for? You can Submit a new open access paper.