Search Results for author: Jiayi Pan

Found 10 papers, 9 papers with code

Autonomous Evaluation and Refinement of Digital Agents

1 code implementation9 Apr 2024 Jiayi Pan, Yichi Zhang, Nicholas Tomlin, Yifei Zhou, Sergey Levine, Alane Suhr

We show that domain-general automatic evaluators can significantly improve the performance of agents for web navigation and device control.

ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL

1 code implementation29 Feb 2024 Yifei Zhou, Andrea Zanette, Jiayi Pan, Sergey Levine, Aviral Kumar

In this paper, we develop a framework for building multi-turn RL algorithms for fine-tuning LLMs, that preserves the flexibility of existing single-turn RL methods for LLMs (e. g., proximal policy optimization), while accommodating multiple turns, long horizons, and delayed rewards effectively.

Language Modelling Reinforcement Learning (RL)

Inversion-Free Image Editing with Natural Language

1 code implementation7 Dec 2023 Sihan Xu, Yidong Huang, Jiayi Pan, Ziqiao Ma, Joyce Chai

We show that when the initial sample is known, a special variance schedule reduces the denoising step to the same form as the multi-step consistency sampling.

Image Manipulation Text-based Image Editing

SmoothQuant+: Accurate and Efficient 4-bit Post-Training WeightQuantization for LLM

2 code implementations6 Dec 2023 Jiayi Pan, Chengcan Wang, Kaifu Zheng, Yangguang Li, Zhenyu Wang, Bin Feng

Our results show that, with SmoothQuant+, the Code Llama-34B model can be quantized and deployed on a A100 40GB GPU, achieving lossless accuracy and a throughput increase of 1. 9 to 4. 0 times compared to the FP16 model deployed on two A100 40GB GPUs.

Quantization

Grounding Visual Illusions in Language: Do Vision-Language Models Perceive Illusions Like Humans?

1 code implementation31 Oct 2023 Yichi Zhang, Jiayi Pan, Yuchen Zhou, Rui Pan, Joyce Chai

Vision-Language Models (VLMs) are trained on vast amounts of data captured by humans emulating our understanding of the world.

World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models

1 code implementation14 Jun 2023 Ziqiao Ma, Jiayi Pan, Joyce Chai

The ability to connect language units to their referents in the physical world, referred to as grounding, is crucial to learning and understanding grounded meanings of words.

Grounded Open Vocabulary Acquisition Language Modelling

Data-Efficient Learning of Natural Language to Linear Temporal Logic Translators for Robot Task Specification

1 code implementation9 Mar 2023 Jiayi Pan, Glen Chou, Dmitry Berenson

We evaluate our approach on three existing LTL/natural language datasets and show that we can translate natural language commands at 75\% accuracy with far less human data ($\le$12 annotations).

FairEdit: Preserving Fairness in Graph Neural Networks through Greedy Graph Editing

1 code implementation10 Jan 2022 Donald Loveland, Jiayi Pan, Aaresh Farrokh Bhathena, Yiyang Lu

While edge deletion is a common method used to promote fairness in GNNs, it fails to consider when data is inherently missing fair connections.

Fairness Graph Representation Learning

Multi-domain Integrative Swin Transformer network for Sparse-View Tomographic Reconstruction

no code implementations28 Nov 2021 Jiayi Pan, Heye Zhang, Weifei Wu, Zhifan Gao, Weiwen Wu

To improve image quality from sparse-view data, a Multi-domain Integrative Swin Transformer network (MIST-net) was developed in this article.

Image Reconstruction

Cannot find the paper you are looking for? You can Submit a new open access paper.