Search Results for author:
Found 2 papers, 1 papers with code
SmartMem: Layout Transformation Elimination and Adaptation for Efficient DNN Execution on Mobile
Focusing on emerging transformers (specifically the ones with computationally efficient Swin-like architectures) and large models (e. g., Stable Diffusion and LLMs) based on transformers, we observe that layout transformations between the computational operators cause a significant slowdown in these applications.
EdgeQAT: Entropy and Distribution Guided Quantization-Aware Training for the Acceleration of Lightweight LLMs on the Edge
In this paper, we propose EdgeQAT, the Entropy and Distribution Guided QAT for the optimization of lightweight LLMs to achieve inference acceleration on Edge devices.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
