Search Results for author:
Found 2 papers, 2 papers with code
RNNs are not Transformers (Yet): The Key Bottleneck on In-context Retrieval
This paper investigates the gap in representation powers of Recurrent Neural Networks (RNNs) and Transformers in the context of solving algorithmic problems.
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
We then propose to search for the optimal per-channel scaling that protects the salient weights by observing the activation, not weights.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
