Search Results for author:
Found 1 papers, 0 papers with code
A Comprehensive Evaluation of Quantization Strategies for Large Language Models
Our experimental results indicate that LLMs with 4-bit quantization can retain performance comparable to their non-quantized counterparts, and perplexity can serve as a proxy metric for quantized LLMs on most benchmarks.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
