Search Results for author:
Found 23 papers, 3 papers with code
Secure Aggregation for Buffered Asynchronous Federated Learning
A buffered asynchronous training protocol known as FedBuff has been proposed recently which bridges the gap between synchronous and asynchronous training to mitigate stragglers and to also ensure privacy simultaneously.
ApproxIFER: A Model-Agnostic Approach to Resilient and Robust Prediction Serving Systems
While this learning-based approach is more resource-efficient than replication, it is tailored to the specific model hosted by the cloud and is particularly suitable for a small number of queries (typically less than four) and tolerating very few (mostly one) number of stragglers.
Basil: A Fast and Byzantine-Resilient Approach for Decentralized Training
As our main contribution, we propose Basil, a fast and computationally efficient Byzantine robust algorithm for decentralized training systems, which leverages a novel sequential, memory assisted and performance-based criteria for training over a logical ring while filtering the Byzantine users.
List-Decodable Coded Computing: Breaking the Adversarial Toleration Barrier
We further propose folded Lagrange coded computing (FLCC) to incorporate the developed techniques into a specific coded computing setting.
On Polynomial Approximations for Privacy-Preserving and Verifiable ReLU Networks
In this work, we empirically show that the square function is not the best degree-2 polynomial that can replace the ReLU function even when restricting the polynomials to have integer coefficients.
A Scalable Approach for Privacy-Preserving Collaborative Machine Learning
We consider a collaborative learning scenario in which multiple data-owners wish to jointly train a logistic regression model, while keeping their individual datasets private from the other parties.
Secure Aggregation with Heterogeneous Quantization in Federated Learning
The state-of-the-art protocols for secure model aggregation, which are based on additive masking, require all users to quantize their model updates to the same level of quantization.
Information Theory Systems and Control Systems and Control Information Theory
Analog Lagrange Coded Computing
Also, the accuracy of outcome is characterized in a practical setting assuming operations are performed using floating-point numbers.
Byzantine-Resilient Secure Federated Learning
This presents a major challenge for the resilience of the model against adversarial (Byzantine) users, who can manipulate the global model by modifying their local models or datasets.
Privacy-Preserving Distributed Learning in the Analog Domain
Then numerical results are shown for experiments on the MNIST dataset.
Coded Computing for Federated Learning at the Edge
Federated Learning (FL) is an exciting new paradigm that enables training a global model from data generated locally at the client nodes, without moving client data to a centralized server.
Minimax Lower Bounds for Transfer Learning with Linear and One-hidden Layer Neural Networks
In this approach a model trained for a source task, where plenty of labeled training data is available, is used as a starting point for training a model on a related target task with only few labeled training data.
Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning
A major bottleneck in scaling federated learning to a large number of users is the overhead of secure model aggregation across many users.
CodedPrivateML: A Fast and Privacy-Preserving Framework for Distributed Machine Learning
How to train a machine learning model while keeping the data private and secure?
Fitting ReLUs via SGD and Quantized SGD
Perhaps unexpectedly, we show that QSGD maintains the fast convergence of SGD to a globally optimal model while significantly reducing the communication cost.
PolyShard: Coded Sharding Achieves Linearly Scaling Efficiency and Security Simultaneously
In particular, we propose PolyShard: ``polynomially coded sharding'' scheme that achieves information-theoretic upper bounds on the efficiency of the storage, system throughput, as well as on trust, thus enabling a truly scalable system.
Cryptography and Security Distributed, Parallel, and Cluster Computing Information Theory Information Theory
Polynomially Coded Regression: Optimal Straggler Mitigation via Data Encoding
In particular, PCR requires a recovery threshold that scales inversely proportionally with the amount of computation/storage available at each worker.
Fundamental Resource Trade-offs for Encoded Distributed Optimization
We also analyze the convergence behavior of iterative encoded optimization algorithms, allowing us to characterize fundamental trade-offs between convergence rate, size of data set, accuracy, computational load (or data redundancy), and straggler toleration in this framework.
Coded Fourier Transform
We consider the problem of computing the Fourier transform of high-dimensional vectors, distributedly over a cluster of machines consisting of a master node and multiple worker nodes, where the worker nodes can only store and process a fraction of the inputs.
Polynomial Codes: an Optimal Design for High-Dimensional Coded Matrix Multiplication
We consider a large-scale matrix multiplication problem where the computation is carried out using a distributed system with a master node and multiple worker nodes, where each worker can store parts of the input matrices.
Information Theory Distributed, Parallel, and Cluster Computing Information Theory
Coded TeraSort
We focus on sorting, which is the building block of many machine learning algorithms, and propose a novel distributed sorting algorithm, named Coded TeraSort, which substantially improves the execution time of the TeraSort benchmark in Hadoop MapReduce.
Distributed, Parallel, and Cluster Computing Information Theory Information Theory
Active Learning On Weighted Graphs Using Adaptive And Non-adaptive Approaches
A new sampling algorithm is proposed, which sequentially selects the graph nodes to be sampled, based on an aggressive search for the boundary of the signal over the graph.
Asymptotic Justification of Bandlimited Interpolation of Graph signals for Semi-Supervised Learning
Graph-based methods play an important role in unsupervised and semi-supervised learning tasks by taking into account the underlying geometry of the data set.
