Search Results for author: Bowen Zhao

Found 24 papers, 5 papers with code

Set the Clock: Temporal Alignment of Pretrained Language Models

1 code implementation26 Feb 2024 Bowen Zhao, Zander Brumbaugh, Yizhong Wang, Hannaneh Hajishirzi, Noah A. Smith

We then develop several methods, from prompting to finetuning, to align LMs to use their most recent knowledge when answering questions, and investigate various factors in this alignment.

APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference

no code implementations22 Jan 2024 Bowen Zhao, Hannaneh Hajishirzi, Qingqing Cao

Compared to baselines, our experiments show that APT maintains up to 98% task performance when pruning RoBERTa and T5 models with 40% parameters left while keeping 86. 4% LLaMA models' performance with 70% parameters remained.

Large Language Models are Complex Table Parsers

no code implementations13 Dec 2023 Bowen Zhao, Changkai Ji, Yuejie Zhang, Wen He, Yingwen Wang, Qing Wang, Rui Feng, Xiaobo Zhang

With the Generative Pre-trained Transformer 3. 5 (GPT-3. 5) exhibiting remarkable reasoning and comprehension abilities in Natural Language Processing (NLP), most Question Answering (QA) research has primarily centered around general QA tasks based on GPT, neglecting the specific challenges posed by Complex Table QA.

Logical Reasoning Question Answering

Neural Impostor: Editing Neural Radiance Fields with Explicit Shape Manipulation

no code implementations9 Oct 2023 Ruiyang Liu, Jinxu Xiang, Bowen Zhao, Ran Zhang, Jingyi Yu, Changxi Zheng

To tackle the problem of efficiently editing neural implicit fields, we introduce Neural Impostor, a hybrid representation incorporating an explicit tetrahedral mesh alongside a multigrid implicit field designated for each tetrahedron within the explicit mesh.

CEC: Crowdsourcing-based Evolutionary Computation for Distributed Optimization

no code implementations12 Apr 2023 Feng-Feng Wei, Wei-neng Chen, Xiao-Qi Guo, Bowen Zhao, Sang-Woon Jeon, Jun Zhang

Inspired by this, this paper intends to introduce crowdsourcing into evolutionary computation (EC) to propose a crowdsourcing-based evolutionary computation (CEC) paradigm for distributed optimization.

Distributed Optimization

When Evolutionary Computation Meets Privacy

no code implementations22 Mar 2023 Bowen Zhao, Wei-neng Chen, Xiaoguo Li, Ximeng Liu, Qingqi Pei, Jun Zhang

To this end, in this paper, we discuss three typical optimization paradigms (i. e., \textit{centralized optimization, distributed optimization, and data-driven optimization}) to characterize optimization modes of evolutionary computation and propose BOOM to sort out privacy concerns in evolutionary computation.

Distributed Computing Distributed Optimization +1

GazeReader: Detecting Unknown Word Using Webcam for English as a Second Language (ESL) Learners

no code implementations18 Mar 2023 Jiexin Ding, Bowen Zhao, Yuqi Huang, Yuntao Wang, Yuanchun Shi

Automatic unknown word detection techniques can enable new applications for assisting English as a Second Language (ESL) learners, thus improving their reading experiences.

named-entity-recognition Named Entity Recognition

A Survey of Secure Computation Using Trusted Execution Environments

no code implementations23 Feb 2023 Xiaoguo Li, Bowen Zhao, Guomin Yang, Tao Xiang, Jian Weng, Robert H. Deng

To the best of our knowledge, this article is the first survey to review TEE-based secure computation protocols and the comprehensive comparison can serve as a guideline for selecting suitable protocols for deployment in practice.

Privacy Preserving

Delving into Identify-Emphasize Paradigm for Combating Unknown Bias

no code implementations22 Feb 2023 Bowen Zhao, Chen Chen, Qian-Wei Wang, Anfeng He, Shu-Tao Xia

For challenge B, we point out that the gradient contribution statistics can be a reliable indicator to inspect whether the optimization is dominated by bias-aligned samples.

DELTA: degradation-free fully test-time adaptation

no code implementations30 Jan 2023 Bowen Zhao, Chen Chen, Shu-Tao Xia

However, we find that two unfavorable defects are concealed in the prevalent adaptation methodologies like test-time batch normalization (BN) and self-learning.

Self-Learning Test-time Adaptation

Controller-Guided Partial Label Consistency Regularization with Unlabeled Data

no code implementations20 Oct 2022 Qian-Wei Wang, Bowen Zhao, Mingyan Zhu, Tianxiang Li, Zimo Liu, Shu-Tao Xia

Partial label learning (PLL) learns from training examples each associated with multiple candidate labels, among which only one is valid.

Contrastive Learning Data Augmentation +2

Towards Effective Image Manipulation Detection with Proposal Contrastive Learning

1 code implementation16 Oct 2022 Yuyuan Zeng, Bowen Zhao, Shanzhao Qiu, Tao Dai, Shu-Tao Xia

Most existing methods mainly focus on extracting global features from tampered images, while neglecting the relationships of local features between tampered and authentic regions within a single tampered image.

Contrastive Learning Image Manipulation +1

Rethinking Attention Mechanism in Time Series Classification

no code implementations14 Jul 2022 Bowen Zhao, Huanlai Xing, Xinhan Wang, Fuhong Song, Zhiwen Xiao

Attention-based models have been widely used in many areas, such as computer vision and natural language processing.

Classification Knowledge Distillation +3

Evolution as a Service: A Privacy-Preserving Genetic Algorithm for Combinatorial Optimization

no code implementations27 May 2022 Bowen Zhao, Wei-neng Chen, Feng-Feng Wei, Ximeng Liu, Qingqi Pei, Jun Zhang

Specifically, PEGA enables users outsourcing COPs to the cloud server holding a competitive GA and approximating the optimal solution in a privacy-preserving manner.

Combinatorial Optimization Evolutionary Algorithms +2

On Jointly Optimizing Partial Offloading and SFC Mapping: A Cooperative Dual-agent Deep Reinforcement Learning Approach

no code implementations20 May 2022 Xinhan Wang, Huanlai Xing, Fuhong Song, Shouxi Luo, Penglin Dai, Bowen Zhao

Mobile devices (MDs) can offload computation-intensive applications, which can be represented by SFCs, fully or partially to MEC servers for remote execution.

Decision Making Edge-computing +2

Combating Unknown Bias with Effective Bias-Conflicting Scoring and Gradient Alignment

1 code implementation25 Nov 2021 Bowen Zhao, Chen Chen, Qian-Wei Wang, Anfeng He, Shu-Tao Xia

For challenge B, we point out that the gradient contribution statistics can be a reliable indicator to inspect whether the optimization is dominated by bias-aligned samples.

Fairness

Energy Aligning for Biased Models

no code implementations7 Jun 2021 Bowen Zhao, Chen Chen, Qi Ju, Shutao Xia

Training on class-imbalanced data usually results in biased models that tend to predict samples into the majority classes, which is a common and notorious problem.

Class Incremental Learning Incremental Learning

When Crowdsensing Meets Federated Learning: Privacy-Preserving Mobile Crowdsensing System

no code implementations20 Feb 2021 Bowen Zhao, Ximeng Liu, Wei-neng Chen

Specifically, in order to protect privacy, participants locally process sensing data via federated learning and only upload encrypted training models.

Federated Learning Privacy Preserving

Towards a category-extended object detector with limited data

no code implementations28 Dec 2020 Bowen Zhao, Chen Chen, Xi Xiao, Shutao Xia

Object detectors are typically learned on fully-annotated training data with fixed predefined categories.

Object

Cannot find the paper you are looking for? You can Submit a new open access paper.