Search Results for author: Mahsa Ghazvini Nejad

Found 1 papers, 0 papers with code

Mitigating Outlier Activations in Low-Precision Fine-Tuning of Language Models

no code implementations14 Dec 2023 Alireza Ghaffari, Justin Yu, Mahsa Ghazvini Nejad, Masoud Asgharian, Boxing Chen, Vahid Partovi Nia

The benefit of using integers for outlier values is that it enables us to use operator tiling to avoid performing 16-bit integer matrix multiplication to address this problem effectively.

Cannot find the paper you are looking for? You can Submit a new open access paper.