Search Results for author: Nilesh Jain

Found 7 papers, 1 papers with code

Shears: Unstructured Sparsity with Neural Low-rank Adapter Search

1 code implementation16 Apr 2024 J. Pablo Muñoz, Jinjie Yuan, Nilesh Jain

Recently, several approaches successfully demonstrated that weight-sharing Neural Architecture Search (NAS) can effectively explore a search space of elastic low-rank adapters (LoRA), allowing the parameter-efficient fine-tuning (PEFT) and compression of large language models.

Neural Architecture Search

Mem-Rec: Memory Efficient Recommendation System using Alternative Representation

no code implementations12 May 2023 Gopi Krishna Jha, Anthony Thomas, Nilesh Jain, Sameh Gobriel, Tajana Rosing, Ravi Iyer

Deep learning-based recommendation systems (e. g., DLRMs) are widely used AI models to provide high-quality personalized recommendations.

Recommendation Systems

Streaming Encoding Algorithms for Scalable Hyperdimensional Computing

no code implementations20 Sep 2022 Anthony Thomas, Behnam Khaleghi, Gopi Krishna Jha, Sanjoy Dasgupta, Nageen Himayat, Ravi Iyer, Nilesh Jain, Tajana Rosing

Hyperdimensional computing (HDC) is a paradigm for data representation and learning originating in computational neuroscience.

EZNAS: Evolving Zero Cost Proxies For Neural Architecture Scoring

no code implementations15 Sep 2022 Yash Akhauri, J. Pablo Munoz, Nilesh Jain, Ravi Iyer

Our methodology efficiently discovers an interpretable and generalizable zero-cost proxy that gives state of the art score-accuracy correlation on all datasets and search spaces of NASBench-201 and Network Design Spaces (NDS).

Neural Architecture Search

RHNAS: Realizable Hardware and Neural Architecture Search

no code implementations17 Jun 2021 Yash Akhauri, Adithya Niranjan, J. Pablo Muñoz, Suvadeep Banerjee, Abhijit Davare, Pasquale Cocchini, Anton A. Sorokin, Ravi Iyer, Nilesh Jain

The rapidly evolving field of Artificial Intelligence necessitates automated approaches to co-design neural network architecture and neural accelerators to maximize system efficiency and address productivity challenges.

Neural Architecture Search

Neuroevolution-Enhanced Multi-Objective Optimization for Mixed-Precision Quantization

no code implementations14 Jun 2021 Santiago Miret, Vui Seng Chua, Mattias Marder, Mariano Phielipp, Nilesh Jain, Somdeb Majumdar

In this work, we present a flexible and scalable framework for automated mixed-precision quantization that concurrently optimizes task performance, memory compression, and compute savings through multi-objective evolutionary computing.

Quantization

Cannot find the paper you are looking for? You can Submit a new open access paper.