2D Parallel Distributed Methods
 
Edit

General • Hybrid Parallel Methods • 5 methods

Methods
Add a Method

Method Year Papers
FastMoE
FastMoE: A Fast Mixture-of-Expert Training System
2021 2
PipeTransformer
PipeTransformer: Automated Elastic Pipelining for Distributed Training of Transformers
2021 1
E2EAdaptiveDistTraining
End-to-end Adaptive Distributed Training on PaddlePaddle
2021 1
Contact us on: hello@paperswithcode.com . Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Data policy Cookies policy