1 code implementation • 29 Sep 2021 • Ling Li, Ali Shafiee, Joseph H Hassoun
Moreover, attention masks regulate the training of attention maps, which facilitates the convergence and improves the accuracy of deeper transformers.
no code implementations • 16 Jun 2021 • Geng Yuan, Payman Behnam, Zhengang Li, Ali Shafiee, Sheng Lin, Xiaolong Ma, Hang Liu, Xuehai Qian, Mahdi Nazm Bojnordi, Yanzhi Wang, Caiwen Ding
With weights stored in the ReRAM crossbar cells as conductance, when the input vector is applied to word lines, the matrix-vector multiplication results can be generated as the current in bit lines.
no code implementations • 27 Jan 2021 • Hamzah Abdel-Aziz, Ali Shafiee, Jong Hoon Shin, Ardavan Pedram, Joseph H. Hassoun
We present novel optimizations based on the above observations to reduce the FP arithmetic hardware overheads.
3 code implementations • ECCV 2020 • Jun Fang, Ali Shafiee, Hamzah Abdel-Aziz, David Thorsley, Georgios Georgiadis, Joseph Hassoun
Quantization plays an important role in the energy-efficient deployment of deep neural networks on resource-limited devices.
no code implementations • 10 Mar 2018 • Anirban Nag, Ali Shafiee, Rajeev Balasubramonian, Vivek Srikumar, Naveen Muralimanohar
Many recent works have designed accelerators for Convolutional Neural Networks (CNNs).