Distributed Methods
PipeMare
Introduced by Yang et al. in PipeMare: Asynchronous Pipeline Parallel DNN TrainingPipeMare is an asynchronous (bubble-free) pipeline parallel method for training large neural networks. It involves two main techniques: learning rate rescheduling and discrepancy correction.
Source: PipeMare: Asynchronous Pipeline Parallel DNN Training
Papers
| Paper | Code | Results | Date | Stars |
|---|
Usage Over Time
Components
| Component | Type |
|
|---|---|---|
| 🤖 No Components Found | You can add them if they exist; e.g. Mask R-CNN uses RoIAlign |
