Search Results for author:
Found 2 papers, 1 papers with code
MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts
However, the gate's routing mechanism also gives rise to narrow vision: the individual MoE's expert fails to use more samples in learning the allocated sub-task, which in turn limits the MoE to further improve its generalization ability.
Lookahead: An Inference Acceleration Framework for Large Language Model with Lossless Generation Accuracy
Instead of generating a single token at a time, we propose a Trie-based retrieval and verification mechanism to be able to accept several tokens at a forward step.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
