Search Results for author: Benjamin Tan

Found 20 papers, 5 papers with code

Explaining EDA synthesis errors with LLMs

no code implementations7 Apr 2024 Siyu Qiu, Benjamin Tan, Hammond Pearce

Training new engineers in digital design is a challenge, particularly when it comes to teaching the complex electronic design automation (EDA) tooling used in this domain.

Question Answering Reading Comprehension

Retrieval-Guided Reinforcement Learning for Boolean Circuit Minimization

no code implementations22 Jan 2024 Animesh Basak Chowdhury, Marco Romanelli, Benjamin Tan, Ramesh Karri, Siddharth Garg

Logic synthesis, a pivotal stage in chip design, entails optimizing chip specifications encoded in hardware description languages like Verilog into highly efficient implementations using Boolean logic gates.

reinforcement-learning Retrieval

Are Emily and Greg Still More Employable than Lakisha and Jamal? Investigating Algorithmic Hiring Bias in the Era of ChatGPT

no code implementations8 Oct 2023 Akshaj Kumar Veldanda, Fabian Grob, Shailja Thakur, Hammond Pearce, Benjamin Tan, Ramesh Karri, Siddharth Garg

We replicate this experiment on state-of-art LLMs (GPT-3. 5, Bard, Claude and Llama) to evaluate bias (or lack thereof) on gender, race, maternity status, pregnancy status, and political affiliation.

VeriGen: A Large Language Model for Verilog Code Generation

no code implementations28 Jul 2023 Shailja Thakur, Baleegh Ahmad, Hammond Pearce, Benjamin Tan, Brendan Dolan-Gavitt, Ramesh Karri, Siddharth Garg

In this study, we explore the capability of Large Language Models (LLMs) to automate hardware design by generating high-quality Verilog code, a common language for designing and modeling digital systems.

Code Generation Language Modelling +1

LLM-assisted Generation of Hardware Assertions

no code implementations24 Jun 2023 Rahul Kande, Hammond Pearce, Benjamin Tan, Brendan Dolan-Gavitt, Shailja Thakur, Ramesh Karri, Jeyavijayan Rajendran

As vulnerabilities in hardware can have severe implications on a system, there is a need for techniques to support security verification activities.

Code Generation

FLAG: Finding Line Anomalies (in code) with Generative AI

no code implementations22 Jun 2023 Baleegh Ahmad, Benjamin Tan, Ramesh Karri, Hammond Pearce

In this work, we explore the features that help LLMs in this classification and evaluate the performance of FLAG on known bugs.

INVICTUS: Optimizing Boolean Logic Circuit Synthesis via Synergistic Learning and Search

no code implementations22 May 2023 Animesh Basak Chowdhury, Marco Romanelli, Benjamin Tan, Ramesh Karri, Siddharth Garg

%Compared to prior work, INVICTUS is the first solution that uses a mix of RL and search methods joint with an online out-of-distribution detector to generate synthesis recipes over a wide range of benchmarks.

Reinforcement Learning (RL)

MALICE: Manipulation Attacks on Learned Image ComprEssion

no code implementations26 May 2022 Kang Liu, Di wu, Yiru Wang, Dan Feng, Benjamin Tan, Siddharth Garg

To characterize the robustness of state-of-the-art learned image compression, we mount white-box and black-box attacks.

Image Compression Image Reconstruction

Too Big to Fail? Active Few-Shot Learning Guided Logic Synthesis

1 code implementation5 Apr 2022 Animesh Basak Chowdhury, Benjamin Tan, Ryan Carey, Tushit Jain, Ramesh Karri, Siddharth Garg

Generating sub-optimal synthesis transformation sequences ("synthesis recipe") is an important problem in logic synthesis.

BIG-bench Machine Learning Few-Shot Learning

Pop Quiz! Can a Large Language Model Help With Reverse Engineering?

no code implementations2 Feb 2022 Hammond Pearce, Benjamin Tan, Prashanth Krishnamurthy, Farshad Khorrami, Ramesh Karri, Brendan Dolan-Gavitt

Large language models (such as OpenAI's Codex) have demonstrated impressive zero-shot multi-task capabilities in the software domain, including code explanation.

Language Modelling Large Language Model

Examining Zero-Shot Vulnerability Repair with Large Language Models

no code implementations3 Dec 2021 Hammond Pearce, Benjamin Tan, Baleegh Ahmad, Ramesh Karri, Brendan Dolan-Gavitt

We perform a large scale study of five commercially available, black-box, "off-the-shelf" LLMs, as well as an open-source model and our own locally-trained model, on a mix of synthetic, hand-crafted, and real-world security bug scenarios.

Code Completion

OpenABC-D: A Large-Scale Dataset For Machine Learning Guided Integrated Circuit Synthesis

1 code implementation21 Oct 2021 Animesh Basak Chowdhury, Benjamin Tan, Ramesh Karri, Siddharth Garg

Logic synthesis is a challenging and widely-researched combinatorial optimization problem during integrated circuit (IC) design.

Benchmarking BIG-bench Machine Learning +1

Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions

2 code implementations20 Aug 2021 Hammond Pearce, Baleegh Ahmad, Benjamin Tan, Brendan Dolan-Gavitt, Ramesh Karri

The most notable of these comes in the form of the first self-described `AI pair programmer', GitHub Copilot, a language model trained over open-source GitHub code.

Code Generation Language Modelling

Subverting Privacy-Preserving GANs: Hiding Secrets in Sanitized Images

no code implementations19 Sep 2020 Kang Liu, Benjamin Tan, Siddharth Garg

Unprecedented data collection and sharing have exacerbated privacy concerns and led to increasing interest in privacy-preserving tools that remove sensitive attributes from images while maintaining useful information for other tasks.

Facial Expression Recognition Facial Expression Recognition (FER) +1

DAVE: Deriving Automatically Verilog from English

no code implementations27 Aug 2020 Hammond Pearce, Benjamin Tan, Ramesh Karri

While specifications for digital systems are provided in natural language, engineers undertake significant efforts to translate them into the programming languages understood by compilers for digital systems.

Translation

Bias Busters: Robustifying DL-based Lithographic Hotspot Detectors Against Backdooring Attacks

no code implementations26 Apr 2020 Kang Liu, Benjamin Tan, Gaurav Rajavendra Reddy, Siddharth Garg, Yiorgos Makris, Ramesh Karri

Deep learning (DL) offers potential improvements throughout the CAD tool-flow, one promising application being lithographic hotspot detection.

Data Augmentation

NNoculation: Catching BadNets in the Wild

1 code implementation19 Feb 2020 Akshaj Kumar Veldanda, Kang Liu, Benjamin Tan, Prashanth Krishnamurthy, Farshad Khorrami, Ramesh Karri, Brendan Dolan-Gavitt, Siddharth Garg

This paper proposes a novel two-stage defense (NNoculation) against backdoored neural networks (BadNets) that, repairs a BadNet both pre-deployment and online in response to backdoored test inputs encountered in the field.

Are Adversarial Perturbations a Showstopper for ML-Based CAD? A Case Study on CNN-Based Lithographic Hotspot Detection

no code implementations25 Jun 2019 Kang Liu, Hao-Yu Yang, Yuzhe ma, Benjamin Tan, Bei Yu, Evangeline F. Y. Young, Ramesh Karri, Siddharth Garg

There is substantial interest in the use of machine learning (ML) based techniques throughout the electronic computer-aided design (CAD) flow, particularly those based on deep learning.

Cannot find the paper you are looking for? You can Submit a new open access paper.