Search Results for author: Jiun-Man Chen

Found 1 papers, 0 papers with code

QuantTune: Optimizing Model Quantization with Adaptive Outlier-Driven Fine Tuning

no code implementations11 Mar 2024 Jiun-Man Chen, Yu-Hsuan Chao, Yu-Jie Wang, Ming-Der Shieh, Chih-Chung Hsu, Wei-Fen Lin

Firstly, our analysis revealed that, on average, 65\% of quantization errors result from the precision loss incurred by the dynamic range amplification effect of outliers across the target Transformer-based models.

Quantization

Cannot find the paper you are looking for? You can Submit a new open access paper.