Search Results for author:
Found 6 papers, 4 papers with code
Ginger: An Efficient Curvature Approximation with Linear Complexity for General Neural Networks
The major reason is due to the quadratic memory and cubic time complexity to compute the inverse of the matrix.
Flora: Low-Rank Adapters Are Secretly Gradient Compressors
Despite large neural networks demonstrating remarkable abilities to complete different tasks, they require excessive memory usage to store the optimization states for training.
Teacher Forcing Recovers Reward Functions for Text Generation
We additionally propose a simple modification to stabilize the RL training on non-parallel datasets with our induced reward function.
An Equal-Size Hard EM Algorithm for Diverse Dialogue Generation
Open-domain dialogue systems aim to interact with humans through natural language texts in an open-ended fashion.
Understanding and Improving Sequence-to-Sequence Pretraining for Neural Machine Translation
In this paper, we present a substantial step in better understanding the SOTA sequence-to-sequence (Seq2Seq) pretraining for neural machine translation~(NMT).
Multi-Task Learning with Shared Encoder for Non-Autoregressive Machine Translation
In addition, experimental results demonstrate that our Multi-Task NAT is complementary to knowledge distillation, the standard knowledge transfer method for NAT.
