Search Results for author:
Found 4 papers, 3 papers with code
LLM Inference Unveiled: Survey and Roofline Model Insights
Our survey stands out from traditional literature reviews by not only summarizing the current state of research but also by introducing a framework based on roofline model for systematic analysis of LLM inference techniques.
Latency-aware Spatial-wise Dynamic Networks
The latency prediction model can efficiently estimate the inference latency of dynamic networks by simultaneously considering algorithms, scheduling strategies, and hardware properties.
PTQ4ViT: Post-Training Quantization Framework for Vision Transformers with Twin Uniform Quantization
We observe the distributions of activation values after softmax and GELU functions are quite different from the Gaussian distribution.
PTQ-SL: Exploring the Sub-layerwise Post-training Quantization
Network quantization is a powerful technique to compress convolutional neural networks.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
