Search Results for author:
Found 5 papers, 2 papers with code
Tenplex: Dynamic Parallelism for Deep Learning using Parallelizable Tensor Collections
After a GPU change, Scalai uses the PTC to transform the job state: the PTC repartitions the dataset state under data parallelism and exposes it to DL workers through a virtual file system; and the PTC obtains the model state as partitioned checkpoints and transforms them to reflect the new parallelization configuration.
Quiver: Supporting GPUs for Low-Latency, High-Throughput GNN Serving with Workload Awareness
Quiver's key idea is to exploit workload metrics for predicting the irregular computation of GNN requests, and governing the use of GPUs for graph sampling and feature aggregation: (1) for graph sampling, Quiver calculates the probabilistic sampled graph size, a metric that predicts the degree of parallelism in graph sampling.
MSRL: Distributed Reinforcement Learning with Dataflow Fragments
Yet, current distributed RL systems tie the definition of RL algorithms to their distributed execution: they hard-code particular distribution strategies and only accelerate specific parts of the computation (e. g. policy network updates) on GPU workers.
CROSSBOW: Scaling Deep Learning with Small Batch Sizes on Multi-GPU Servers
Systems such as TensorFlow and Caffe2 train models with parallel synchronous stochastic gradient descent: they process a batch of training data at a time, partitioned across GPUs, and average the resulting partial gradients to obtain an updated global model.
Teechan: Payment Channels Using Trusted Execution Environments
We present Teechan, a full-duplex payment channel framework that exploits trusted execution environments.
Cryptography and Security
