Search Results for author:
Found 1 papers, 0 papers with code
Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression
In particular, our approach extracts knowledge from LLMs to construct a knowledge store, from which the small-scale model can retrieve relevant information and leverage it for effective inference.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
