Search Results for author: Siddharth Garg

Found 48 papers, 13 papers with code

Learned Pulse Shaping Design for PAPR Reduction in DFT-s-OFDM

no code implementations24 Apr 2024 Fabrizio Carpi, Soheil Rostami, Joonyoung Cho, Siddharth Garg, Elza Erkip, Charlie Jianzhong Zhang

High peak-to-average power ratio (PAPR) is one of the main factors limiting cell coverage for cellular systems, especially in the uplink direction.

On the (In)feasibility of ML Backdoor Detection as an Hypothesis Testing Problem

1 code implementation26 Feb 2024 Georg Pichler, Marco Romanelli, Divya Prakash Manivannan, Prashanth Krishnamurthy, Farshad Khorrami, Siddharth Garg

We introduce a formal statistical definition for the problem of backdoor detection in machine learning systems and use it to analyze the feasibility of such problems, providing evidence for the utility and applicability of our definition.

Automated Theorem Proving Out-of-Distribution Detection

Make Every Move Count: LLM-based High-Quality RTL Code Generation Using MCTS

no code implementations5 Feb 2024 Matthew DeLorenzo, Animesh Basak Chowdhury, Vasudev Gohil, Shailja Thakur, Ramesh Karri, Siddharth Garg, Jeyavijayan Rajendran

Existing large language models (LLMs) for register transfer level code generation face challenges like compilation failures and suboptimal power, performance, and area (PPA) efficiency.

Code Generation Language Modelling

Novel Quadratic Constraints for Extending LipSDP beyond Slope-Restricted Activations

no code implementations25 Jan 2024 Patricia Pauli, Aaron Havens, Alexandre Araujo, Siddharth Garg, Farshad Khorrami, Frank Allgöwer, Bin Hu

However, a direct application of LipSDP to the resultant residual ReLU networks is conservative and even fails in recovering the well-known fact that the MaxMin activation is 1-Lipschitz.

Retrieval-Guided Reinforcement Learning for Boolean Circuit Minimization

no code implementations22 Jan 2024 Animesh Basak Chowdhury, Marco Romanelli, Benjamin Tan, Ramesh Karri, Siddharth Garg

Logic synthesis, a pivotal stage in chip design, entails optimizing chip specifications encoded in hardware description languages like Verilog into highly efficient implementations using Boolean logic gates.

reinforcement-learning Retrieval

LipSim: A Provably Robust Perceptual Similarity Metric

1 code implementation27 Oct 2023 Sara Ghazanfari, Alexandre Araujo, Prashanth Krishnamurthy, Farshad Khorrami, Siddharth Garg

On the other hand, as perceptual metrics rely on neural networks, there is a growing concern regarding their resilience, given the established vulnerability of neural networks to adversarial attacks.

Image Retrieval Retrieval

Towards the Imagenets of ML4EDA

no code implementations16 Oct 2023 Animesh Basak Chowdhury, Shailja Thakur, Hammond Pearce, Ramesh Karri, Siddharth Garg

Here we describe our experience curating two large-scale, high-quality datasets for Verilog code generation and logic synthesis.

Code Generation Data Augmentation

Are Emily and Greg Still More Employable than Lakisha and Jamal? Investigating Algorithmic Hiring Bias in the Era of ChatGPT

no code implementations8 Oct 2023 Akshaj Kumar Veldanda, Fabian Grob, Shailja Thakur, Hammond Pearce, Benjamin Tan, Ramesh Karri, Siddharth Garg

We replicate this experiment on state-of-art LLMs (GPT-3. 5, Bard, Claude and Llama) to evaluate bias (or lack thereof) on gender, race, maternity status, pregnancy status, and political affiliation.

PriViT: Vision Transformers for Fast Private Inference

1 code implementation6 Oct 2023 Naren Dhyani, Jianqiao Mo, Minsu Cho, Ameya Joshi, Siddharth Garg, Brandon Reagen, Chinmay Hegde

The Vision Transformer (ViT) architecture has emerged as the backbone of choice for state-of-the-art deep models for computer vision applications.

Image Classification

VeriGen: A Large Language Model for Verilog Code Generation

no code implementations28 Jul 2023 Shailja Thakur, Baleegh Ahmad, Hammond Pearce, Benjamin Tan, Brendan Dolan-Gavitt, Ramesh Karri, Siddharth Garg

In this study, we explore the capability of Large Language Models (LLMs) to automate hardware design by generating high-quality Verilog code, a common language for designing and modeling digital systems.

Code Generation Language Modelling +1

R-LPIPS: An Adversarially Robust Perceptual Similarity Metric

1 code implementation27 Jul 2023 Sara Ghazanfari, Siddharth Garg, Prashanth Krishnamurthy, Farshad Khorrami, Alexandre Araujo

In this paper, we propose the Robust Learned Perceptual Image Patch Similarity (R-LPIPS) metric, a new metric that leverages adversarially trained deep features.

Differential Analysis of Triggers and Benign Features for Black-Box DNN Backdoor Detection

1 code implementation11 Jul 2023 Hao Fu, Prashanth Krishnamurthy, Siddharth Garg, Farshad Khorrami

Having the computed five metrics, five novelty detectors are trained from the validation dataset.

Towards Better Certified Segmentation via Diffusion Models

no code implementations16 Jun 2023 Othmane Laousy, Alexandre Araujo, Guillaume Chassagnon, Marie-Pierre Revel, Siddharth Garg, Farshad Khorrami, Maria Vakalopoulou

The robustness of image segmentation has been an important research topic in the past few years as segmentation models have reached production-level accuracy.

Autonomous Driving Image Segmentation +2

INVICTUS: Optimizing Boolean Logic Circuit Synthesis via Synergistic Learning and Search

no code implementations22 May 2023 Animesh Basak Chowdhury, Marco Romanelli, Benjamin Tan, Ramesh Karri, Siddharth Garg

%Compared to prior work, INVICTUS is the first solution that uses a mix of RL and search methods joint with an online out-of-distribution detector to generate synthesis recipes over a wide range of benchmarks.

Reinforcement Learning (RL)

Chip-Chat: Challenges and Opportunities in Conversational Hardware Design

1 code implementation22 May 2023 Jason Blocklove, Siddharth Garg, Ramesh Karri, Hammond Pearce

Modern hardware design starts with specifications provided in natural language.

Can deepfakes be created by novice users?

no code implementations28 Apr 2023 Pulak Mehta, Gauri Jagatap, Kevin Gallagher, Brian Timmerman, Progga Deb, Siddharth Garg, Rachel Greenstadt, Brendan Dolan-Gavitt

We conclude that creating Deepfakes is a simple enough task for a novice user given adequate tools and time; however, the resulting Deepfakes are not sufficiently real-looking and are unable to completely fool detection software as well as human examiners

DeepFake Detection Face Swapping

Precoding-oriented Massive MIMO CSI Feedback Design

no code implementations22 Feb 2023 Fabrizio Carpi, Sivarama Venkatesan, Jinfeng Du, Harish Viswanathan, Siddharth Garg, Elza Erkip

Downlink massive multiple-input multiple-output (MIMO) precoding algorithms in frequency division duplexing (FDD) systems rely on accurate channel state information (CSI) feedback from users.

A Minimax Approach Against Multi-Armed Adversarial Attacks Detection

no code implementations4 Feb 2023 Federica Granese, Marco Romanelli, Siddharth Garg, Pablo Piantanida

Multi-armed adversarial attacks, in which multiple algorithms and objective loss functions are simultaneously used at evaluation time, have been shown to be highly successful in fooling state-of-the-art adversarial examples detectors while requiring no specific side information about the detection mechanism.

Privacy-Preserving Collaborative Learning through Feature Extraction

no code implementations13 Dec 2022 Alireza Sarmadi, Hao Fu, Prashanth Krishnamurthy, Siddharth Garg, Farshad Khorrami

As a baseline, in Cooperatively Trained Feature Extractor (CTFE) Learning, the entities train models by sharing raw data.

Fraud Detection Inference Attack +2

Fairness via In-Processing in the Over-parameterized Regime: A Cautionary Tale

no code implementations29 Jun 2022 Akshaj Kumar Veldanda, Ivan Brugere, Jiahao Chen, Sanghamitra Dutta, Alan Mishler, Siddharth Garg

We further show that MinDiff optimization is very sensitive to choice of batch size in the under-parameterized regime.

Fairness

MALICE: Manipulation Attacks on Learned Image ComprEssion

no code implementations26 May 2022 Kang Liu, Di wu, Yiru Wang, Dan Feng, Benjamin Tan, Siddharth Garg

To characterize the robustness of state-of-the-art learned image compression, we mount white-box and black-box attacks.

Image Compression Image Reconstruction

Feature Compression for Rate Constrained Object Detection on the Edge

no code implementations15 Apr 2022 Zhongzheng Yuan, Samyak Rawlekar, Siddharth Garg, Elza Erkip, Yao Wang

In this work, we consider a "split computation" system to offload a part of the computation of the YOLO object detection model.

Feature Compression object-detection +1

Too Big to Fail? Active Few-Shot Learning Guided Logic Synthesis

1 code implementation5 Apr 2022 Animesh Basak Chowdhury, Benjamin Tan, Ryan Carey, Tushit Jain, Ramesh Karri, Siddharth Garg

Generating sub-optimal synthesis transformation sequences ("synthesis recipe") is an important problem in logic synthesis.

BIG-bench Machine Learning Few-Shot Learning

Selective Network Linearization for Efficient Private Inference

1 code implementation4 Feb 2022 Minsu Cho, Ameya Joshi, Siddharth Garg, Brandon Reagen, Chinmay Hegde

To reduce PI latency we propose a gradient-based algorithm that selectively linearizes ReLUs while maintaining prediction accuracy.

OpenABC-D: A Large-Scale Dataset For Machine Learning Guided Integrated Circuit Synthesis

1 code implementation21 Oct 2021 Animesh Basak Chowdhury, Benjamin Tan, Ramesh Karri, Siddharth Garg

Logic synthesis is a challenging and widely-researched combinatorial optimization problem during integrated circuit (IC) design.

Benchmarking BIG-bench Machine Learning +1

Sphynx: ReLU-Efficient Network Design for Private Inference

no code implementations17 Jun 2021 Minsu Cho, Zahra Ghodsi, Brandon Reagen, Siddharth Garg, Chinmay Hegde

The emergence of deep learning has been accompanied by privacy concerns surrounding users' data and service providers' models.

Circa: Stochastic ReLUs for Private Deep Learning

no code implementations NeurIPS 2021 Zahra Ghodsi, Nandan Kumar Jha, Brandon Reagen, Siddharth Garg

In this paper we re-think the ReLU computation and propose optimizations for PI tailored to properties of neural networks.

Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehicles

no code implementations12 Mar 2021 Zahra Ghodsi, Siva Kumar Sastry Hari, Iuri Frosio, Timothy Tsai, Alejandro Troccoli, Stephen W. Keckler, Siddharth Garg, Anima Anandkumar

Extracting interesting scenarios from real-world data as well as generating failure cases is important for the development and testing of autonomous systems.

Autonomous Vehicles

DeepReDuce: ReLU Reduction for Fast Private Inference

no code implementations2 Mar 2021 Nandan Kumar Jha, Zahra Ghodsi, Siddharth Garg, Brandon Reagen

This paper proposes DeepReDuce: a set of optimizations for the judicious removal of ReLUs to reduce private inference latency.

Bait and Switch: Online Training Data Poisoning of Autonomous Driving Systems

no code implementations8 Nov 2020 Naman Patel, Prashanth Krishnamurthy, Siddharth Garg, Farshad Khorrami

We show that by controlling parts of a physical environment in which a pre-trained deep neural network (DNN) is being fine-tuned online, an adversary can launch subtle data poisoning attacks that degrade the performance of the system.

Autonomous Driving Data Poisoning

Detecting Backdoors in Neural Networks Using Novel Feature-Based Anomaly Detection

no code implementations4 Nov 2020 Hao Fu, Akshaj Kumar Veldanda, Prashanth Krishnamurthy, Siddharth Garg, Farshad Khorrami

This paper proposes a new defense against neural network backdooring attacks that are maliciously trained to mispredict in the presence of attacker-chosen triggers.

Anomaly Detection Data Augmentation

On Evaluating Neural Network Backdoor Defenses

no code implementations23 Oct 2020 Akshaj Veldanda, Siddharth Garg

Deep neural networks (DNNs) demonstrate superior performance in various fields, including scrutiny and security.

Subverting Privacy-Preserving GANs: Hiding Secrets in Sanitized Images

no code implementations19 Sep 2020 Kang Liu, Benjamin Tan, Siddharth Garg

Unprecedented data collection and sharing have exacerbated privacy concerns and led to increasing interest in privacy-preserving tools that remove sensitive attributes from images while maintaining useful information for other tasks.

Facial Expression Recognition Facial Expression Recognition (FER) +1

CryptoNAS: Private Inference on a ReLU Budget

no code implementations NeurIPS 2020 Zahra Ghodsi, Akshaj Veldanda, Brandon Reagen, Siddharth Garg

Machine learning as a service has given raise to privacy concerns surrounding clients' data and providers' models and has catalyzed research in private inference (PI): methods to process inferences without disclosing inputs.

Bias Busters: Robustifying DL-based Lithographic Hotspot Detectors Against Backdooring Attacks

no code implementations26 Apr 2020 Kang Liu, Benjamin Tan, Gaurav Rajavendra Reddy, Siddharth Garg, Yiorgos Makris, Ramesh Karri

Deep learning (DL) offers potential improvements throughout the CAD tool-flow, one promising application being lithographic hotspot detection.

Data Augmentation

NNoculation: Catching BadNets in the Wild

1 code implementation19 Feb 2020 Akshaj Kumar Veldanda, Kang Liu, Benjamin Tan, Prashanth Krishnamurthy, Farshad Khorrami, Ramesh Karri, Brendan Dolan-Gavitt, Siddharth Garg

This paper proposes a novel two-stage defense (NNoculation) against backdoored neural networks (BadNets) that, repairs a BadNet both pre-deployment and online in response to backdoored test inputs encountered in the field.

Are Adversarial Perturbations a Showstopper for ML-Based CAD? A Case Study on CNN-Based Lithographic Hotspot Detection

no code implementations25 Jun 2019 Kang Liu, Hao-Yu Yang, Yuzhe ma, Benjamin Tan, Bei Yu, Evangeline F. Y. Young, Ramesh Karri, Siddharth Garg

There is substantial interest in the use of machine learning (ML) based techniques throughout the electronic computer-aided design (CAD) flow, particularly those based on deep learning.

FATE: Fast and Accurate Timing Error Prediction Framework for Low Power DNN Accelerator Design

no code implementations2 Jul 2018 Jeff Zhang, Siddharth Garg

FATE proposes two novel ideas: (i) DelayNet, a DNN based timing model for MAC units; and (ii) a statistical sampling methodology that reduces the number of MAC operations for which timing simulations are performed.

General Classification

Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networks

3 code implementations30 May 2018 Kang Liu, Brendan Dolan-Gavitt, Siddharth Garg

Our work provides the first step toward defenses against backdoor attacks in deep neural networks.

ThUnderVolt: Enabling Aggressive Voltage Underscaling and Timing Error Resilience for Energy Efficient Deep Neural Network Accelerators

no code implementations11 Feb 2018 Jeff Zhang, Kartheek Rangineni, Zahra Ghodsi, Siddharth Garg

Hardware accelerators are being increasingly deployed to boost the performance and energy efficiency of deep neural network (DNN) inference.

General Classification

Analyzing and Mitigating the Impact of Permanent Faults on a Systolic Array Based Neural Network Accelerator

no code implementations11 Feb 2018 Jeff Zhang, Tianyu Gu, Kanad Basu, Siddharth Garg

Due to their growing popularity and computational cost, deep neural networks (DNNs) are being targeted for hardware acceleration.

General Classification

BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain

10 code implementations22 Aug 2017 Tianyu Gu, Brendan Dolan-Gavitt, Siddharth Garg

These results demonstrate that backdoors in neural networks are both powerful and---because the behavior of neural networks is difficult to explicate---stealthy.

BIG-bench Machine Learning

SafetyNets: Verifiable Execution of Deep Neural Networks on an Untrusted Cloud

no code implementations NeurIPS 2017 Zahra Ghodsi, Tianyu Gu, Siddharth Garg

Specifically, SafetyNets develops and implements a specialized interactive proof (IP) protocol for verifiable execution of a class of deep neural networks, i. e., those that can be represented as arithmetic circuits.

speech-recognition Speech Recognition

Cannot find the paper you are looking for? You can Submit a new open access paper.