SLoRA: Federated Parameter Efficient Fine-Tuning of Language Models

no code implementations • 12 Aug 2023 • Sara Babakniya, Ahmed Roushdy Elkordy, Yahya H. Ezzeldin, Qingfeng Liu, Kee-Bong Song, Mostafa El-Khamy, Salman Avestimehr

In the absence of centralized data, Federated Learning (FL) can benefit from distributed and private data of the FL edge clients for fine-tuning.

Federated Learning Transfer Learning

Machine Collaboration

no code implementations • 6 May 2021 • Qingfeng Liu, Yang Feng

We propose a new ensemble framework for supervised learning, called machine collaboration (MaC), using a collection of base machines for prediction tasks.