Search Results for author: Chengyi Yang

Found 7 papers, 1 papers with code

Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal

no code implementations2 Mar 2024 Jianheng Huang, Leyang Cui, Ante Wang, Chengyi Yang, Xinting Liao, Linfeng Song, Junfeng Yao, Jinsong Su

When conducting continual learning based on a publicly-released LLM checkpoint, the availability of the original training data may be non-existent.

Continual Learning In-Context Learning

Wasserstein Differential Privacy

1 code implementation23 Jan 2024 Chengyi Yang, Jiayin Qi, Aimin Zhou

We propose Wasserstein differential privacy (WDP), an alternative DP framework to measure the risk of privacy leakage, which satisfies the properties of symmetry and triangle inequality.

Privacy Preserving

Federated Learning in Big Model Era: Domain-Specific Multimodal Large Models

no code implementations22 Aug 2023 Zengxiang Li, Zhaoxiang Hou, Hui Liu, Ying Wang, Tongzhi Li, Longfei Xie, Chao Shi, Chengyi Yang, Weishan Zhang, Zelei Liu, Liang Xu

Preliminary experiments show that enterprises can enhance and accumulate intelligent capabilities through multimodal model federated learning, thereby jointly creating an smart city model that provides high-quality intelligent services covering energy infrastructure safety, residential community security, and urban operation management.

Federated Learning Management

The Prospect of Enhancing Large-Scale Heterogeneous Federated Learning with Transformers

no code implementations7 Aug 2023 Yulan Gao, Zhaoxiang Hou, Chengyi Yang, Zengxiang Li, Han Yu

Federated learning (FL) addresses data privacy concerns by enabling collaborative training of AI models across distributed data owners.

Federated Learning

Hierarchical Federated Learning Incentivization for Gas Usage Estimation

no code implementations1 Jul 2023 Has Sun, Xiaoli Tang, Chengyi Yang, Zhenpeng Yu, Xiuli Wang, Qijie Ding, Zengxiang Li, Han Yu

Federated learning (FL) offers a solution to this problem by enabling local data processing on each participant, such as gas companies and heating stations.

Fairness Federated Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.