Search Results for author: Yun Chen

Found 54 papers, 18 papers with code

Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation

1 code implementation ACL 2022 Guanhua Chen, Shuming Ma, Yun Chen, Dongdong Zhang, Jia Pan, Wenping Wang, Furu Wei

When applied to zero-shot cross-lingual abstractive summarization, it produces an average performance gain of 12. 3 ROUGE-L over mBART-ft. We conduct detailed analyses to understand the key ingredients of SixT+, including multilinguality of the auxiliary parallel data, positional disentangled encoder, and the cross-lingual transferability of its encoder.

Abstractive Text Summarization Cross-Lingual Abstractive Summarization +5

Tastle: Distract Large Language Models for Automatic Jailbreak Attack

no code implementations13 Mar 2024 Zeguan Xiao, Yan Yang, Guanhua Chen, Yun Chen

In this work, we propose Tastle, a novel black-box jailbreak framework for automated red teaming of LLMs.

OMGEval: An Open Multilingual Generative Evaluation Benchmark for Large Language Models

1 code implementation21 Feb 2024 Meng Xu, Shuo Wang, Liner Yang, Haoyu Wang, Zhenghao Liu, Cunliang Kong, Yun Chen, Yang Liu, Maosong Sun, Erhong Yang

We evaluate several representative multilingual LLMs on the proposed OMGEval, which we believe will provide a valuable reference for the community to further understand and improve the multilingual capability of LLMs.

General Knowledge Logical Reasoning

LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks

no code implementations18 Feb 2024 Hanqing Wang, Bowen Ping, Shuo Wang, Xu Han, Yun Chen, Zhiyuan Liu, Maosong Sun

Most prior works on LoRA combination primarily rely on task-level weights for each involved LoRA, making different examples and tokens share the same LoRA weights.

Math

Attention-based Interactive Disentangling Network for Instance-level Emotional Voice Conversion

no code implementations29 Dec 2023 Yun Chen, Lingxiao Yang, Qi Chen, Jian-Huang Lai, Xiaohua Xie

We introduce a two-stage pipeline to effectively train our network: Stage I utilizes inter-speech contrastive learning to model fine-grained emotion and intra-speech disentanglement learning to better separate emotion and content.

Contrastive Learning Disentanglement +1

LightSim: Neural Lighting Simulation for Urban Scenes

no code implementations11 Dec 2023 Ava Pun, Gary Sun, Jingkang Wang, Yun Chen, Ze Yang, Sivabalan Manivasagam, Wei-Chiu Ma, Raquel Urtasun

Different outdoor illumination conditions drastically alter the appearance of urban scenes, and they can harm the performance of image-based robot perception systems if not seen during training.

Reconstructing Objects in-the-wild for Realistic Sensor Simulation

no code implementations9 Nov 2023 Ze Yang, Sivabalan Manivasagam, Yun Chen, Jingkang Wang, Rui Hu, Raquel Urtasun

In this work, we present NeuSim, a novel approach that estimates accurate geometry and realistic appearance from sparse in-the-wild data captured at distance and at limited viewpoints.

CADSim: Robust and Scalable in-the-wild 3D Reconstruction for Controllable Sensor Simulation

no code implementations2 Nov 2023 Jingkang Wang, Sivabalan Manivasagam, Yun Chen, Ze Yang, Ioan Andrei Bârsan, Anqi Joyce Yang, Wei-Chiu Ma, Raquel Urtasun

To tackle these issues, we present CADSim, which combines part-aware object-class priors via a small set of CAD models with differentiable rendering to automatically reconstruct vehicle geometry, including articulated wheels, with high-quality appearance.

3D Reconstruction

StyleBART: Decorate Pretrained Model with Style Adapters for Unsupervised Stylistic Headline Generation

no code implementations26 Oct 2023 Hanqing Wang, Yajing Luo, Boya Xiong, Guanhua Chen, Yun Chen

Stylistic headline generation is the task to generate a headline that not only summarizes the content of an article, but also reflects a desired style that attracts users.

Headline Generation

TADIS: Steering Models for Deep-Thinking about Demonstration Examples

no code implementations2 Oct 2023 Tianci Xue, Ziqi Wang, Yixia Li, Yun Chen, Guanhua Chen

To alleviate the illusion of competence of models, we first ask the model to verify the correctness of shown examples.

Instruction Following Zero-shot Generalization

Sparse Recovery with Attention: A Hybrid Data/Model Driven Solution for High Accuracy Position and Channel Tracking at mmWave

no code implementations26 Aug 2023 Yun Chen, Nuria González-Prelcic, Takayuki Shimizu, Hongshen Lu, Chinmay Mahabal

In this paper, we propose first a mmWave channel tracking algorithm based on multidimensional orthogonal matching pursuit algorithm (MOMP) using reduced sparsifying dictionaries, which exploits information from channel estimates in previous frames.

Position

FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models

1 code implementation19 Aug 2023 Liwen Zhang, Weige Cai, Zhaowei Liu, Zhi Yang, Wei Dai, Yujie Liao, Qianru Qin, Yifei Li, Xingyu Liu, Zhiqiang Liu, Zhoufan Zhu, Anbo Wu, Xin Guo, Yun Chen

Our work offers a more comprehensive financial knowledge evaluation benchmark, utilizing data of mock exams and covering a wide range of evaluated LLMs.

Multiple-choice

UniSim: A Neural Closed-Loop Sensor Simulator

1 code implementation CVPR 2023 Ze Yang, Yun Chen, Jingkang Wang, Sivabalan Manivasagam, Wei-Chiu Ma, Anqi Joyce Yang, Raquel Urtasun

Previously recorded driving logs provide a rich resource to build these new scenarios from, but for closed loop evaluation, we need to modify the sensor data based on the new scene configuration and the SDV's decisions, as actors might be added or removed and the trajectories of existing actors and the SDV will differ from the original log.

Target Search and Navigation in Heterogeneous Robot Systems with Deep Reinforcement Learning

no code implementations1 Aug 2023 Yun Chen, Jiaping Xiao

Collaborative heterogeneous robot systems can greatly improve the efficiency of target search and navigation tasks.

Navigate reinforcement-learning

mCLIP: Multilingual CLIP via Cross-lingual Transfer

1 code implementation ACL 2023 Guanhua Chen, Lu Hou, Yun Chen, Wenliang Dai, Lifeng Shang, Xin Jiang, Qun Liu, Jia Pan, Wenping Wang

Furthermore, to enhance the token- and sentence-level multilingual representation of the MTE, we propose to train it with machine translation and contrastive learning jointly before the TriKD to provide a better initialization.

Contrastive Learning Cross-Lingual Transfer +7

Learning to Localize with Attention: from sparse mmWave channel estimates from a single BS to high accuracy 3D location

no code implementations30 Jun 2023 Yun Chen, Nuria González-Prelcic, Takayuki Shimizu, HongSheng Lu

One strategy to obtain user location information in a wireless network operating at millimeter wave (mmWave) is based on the exploitation of the geometric relationships between the channel parameters and the user position.

Position

Multilingual Sentence Transformer as A Multilingual Word Aligner

1 code implementation28 Jan 2023 Weikang Wang, Guanhua Chen, Hanqing Wang, Yue Han, Yun Chen

In this paper, we investigate whether multilingual sentence Transformer LaBSE is a strong multilingual word aligner.

Sentence Word Alignment +1

Lexical Complexity Controlled Sentence Generation

no code implementations26 Nov 2022 Jinran Nie, Liner Yang, Yun Chen, Cunliang Kong, Junhui Zhu, Erhong Yang

Compared with potential solutions, our approach fuses the representations of the word complexity levels into the model to get better control of lexical complexity.

Sentence Text Generation

RIS-ADMM: A RIS and ADMM-Based Passive and Sparse Sensing Method With Interference Removal

1 code implementation25 May 2022 Peng Chen, Zhimin Chen, Pu Miao, Yun Chen

This letter addresses the passive sensing issue utilizing wireless communication signals and RIS amidst interference from wireless access points (APs).

LitMind Dictionary: An Open-Source Online Dictionary

1 code implementation23 Apr 2022 Cunliang Kong, Xuezhi Fang, Liner Yang, Yun Chen, Erhong Yang

Since traditional dictionaries present word senses as discrete items in predefined inventories, they fall short of flexibility, which is required in providing specific meanings of words in particular contexts.

PrivateRec: Differentially Private Training and Serving for Federated News Recommendation

no code implementations18 Apr 2022 Ruixuan Liu, Yanlin Wang, Yang Cao, Lingjuan Lyu, Weike Pan, Yun Chen, Hong Chen

Collecting and training over sensitive personal data raise severe privacy concerns in personalized recommendation systems, and federated learning can potentially alleviate the problem by training models over decentralized user data. However, a theoretically private solution in both the training and serving stages of federated recommendation is essential but still lacking. Furthermore, naively applying differential privacy (DP) to the two stages in federated recommendation would fail to achieve a satisfactory trade-off between privacy and utility due to the high-dimensional characteristics of model gradients and hidden representations. In this work, we propose a federated news recommendation method for achieving a better utility in model training and online serving under a DP guarantee. We first clarify the DP definition over behavior data for each round in the life-circle of federated recommendation systems. Next, we propose a privacy-preserving online serving mechanism under this definition based on the idea of decomposing user embeddings with public basic vectors and perturbing the lower-dimensional combination coefficients.

Federated Learning News Recommendation +2

Joint Initial Access and Localization in Millimeter Wave Vehicular Networks: a Hybrid Model/Data Driven Approach

no code implementations4 Apr 2022 Yun Chen, Joan Palacios, Nuria González-Prelcic, Takayuki Shimizu, HongSheng Lu

High resolution compressive channel estimation provides information for vehicle localization when a hybrid mmWave MIMO system is considered.

Multitasking Framework for Unsupervised Simple Definition Generation

2 code implementations ACL 2022 Cunliang Kong, Yun Chen, Hengyuan Zhang, Liner Yang, Erhong Yang

We demonstrate that the framework can generate relevant, simple definitions for the target words through automatic and manual evaluations on English and Chinese datasets.

SDOA-Net: An Efficient Deep Learning-Based DOA Estimation Network for Imperfect Array

2 code implementations19 Mar 2022 Peng Chen, Zhimin Chen, Liang Liu, Yun Chen, Xianbin Wang

The estimation of direction of arrival (DOA) is a crucial issue in conventional radar, wireless communication, and integrated sensing and communication (ISAC) systems.

Super-Resolution

Deep Learning-based Link Configuration for Radar-aided Multiuser mmWave Vehicle-to-Infrastructure Communication

no code implementations12 Jan 2022 Andrew Graff, Yun Chen, Nuria González-Prelcic, Takayuki Shimizu

Then, a deep network is used to translate features of these radar spatial covariances into features of the communication spatial covariances, by learning the intricate mapping between radar and communication channels, in both line-of-sight and non-line-of-sight settings.

YACLC: A Chinese Learner Corpus with Multidimensional Annotation

1 code implementation30 Dec 2021 Yingying Wang, Cunliang Kong, Liner Yang, Yijun Wang, Xiaorong Lu, Renfen Hu, Shan He, Zhenghao Liu, Yun Chen, Erhong Yang, Maosong Sun

This resource is of great relevance for second language acquisition research, foreign-language teaching, and automatic grammatical error correction.

Grammatical Error Correction Language Acquisition +1

Radar Aided mmWave Vehicle-to-InfrastructureLink Configuration Using Deep Learning

no code implementations16 Nov 2021 Yun Chen, Andrew Graff, Nuria González-Prelcic, Takayuki Shimizu

In this paper, we obtain prior information to speed up the beam training process by implementing two deep neural networks (DNNs) that realize radar-to-communication (R2C) channel information translation in a vehicle-to-infrastructure (V2I) system.

Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translation

1 code implementation16 Oct 2021 Guanhua Chen, Shuming Ma, Yun Chen, Dongdong Zhang, Jia Pan, Wenping Wang, Furu Wei

When applied to zero-shot cross-lingual abstractive summarization, it produces an average performance gain of 12. 3 ROUGE-L over mBART-ft. We conduct detailed analyses to understand the key ingredients of SixT+, including multilinguality of the auxiliary parallel data, positional disentangled encoder, and the cross-lingual transferability of its encoder.

Abstractive Text Summarization Cross-Lingual Abstractive Summarization +5

Few-Shot Domain Adaptation for Grammatical Error Correction via Meta-Learning

no code implementations29 Jan 2021 Shengsheng Zhang, Yaping Huang, Yun Chen, Liner Yang, Chencheng Wang, Erhong Yang

We exploit a set of data-rich source domains to learn the initialization of model parameters that facilitates fast adaptation on new resource-poor target domains.

Domain Adaptation Grammatical Error Correction +2

Exploring Adversarial Robustness of Multi-Sensor Perception Systems in Self Driving

no code implementations17 Jan 2021 James Tu, Huichen Li, Xinchen Yan, Mengye Ren, Yun Chen, Ming Liang, Eilyan Bitar, Ersin Yumer, Raquel Urtasun

Yet, there have been limited studies on the adversarial robustness of multi-modal models that fuse LiDAR features with image features.

Adversarial Robustness Denoising +1

DSDNet: Deep Structured self-Driving Network

no code implementations ECCV 2020 Wenyuan Zeng, Shenlong Wang, Renjie Liao, Yun Chen, Bin Yang, Raquel Urtasun

In this paper, we propose the Deep Structured self-Driving Network (DSDNet), which performs object detection, motion prediction, and motion planning with a single neural network.

Motion Planning motion prediction +2

Learning Lane Graph Representations for Motion Forecasting

1 code implementation ECCV 2020 Ming Liang, Bin Yang, Rui Hu, Yun Chen, Renjie Liao, Song Feng, Raquel Urtasun

We propose a motion forecasting model that exploits a novel structured map representation as well as actor-map interactions.

Motion Forecasting Trajectory Prediction

A Deep Reinforcement Learning Approach to Efficient Drone Mobility Support

no code implementations11 May 2020 Yun Chen, Xingqin Lin, Talha Ahmed Khan, Mohammad Mozaffari

In this paper, we propose a novel handover framework for providing efficient mobility support and reliable wireless connectivity to drones served by a terrestrial cellular network.

Q-Learning reinforcement-learning +1

Accurate Word Alignment Induction from Neural Machine Translation

1 code implementation EMNLP 2020 Yun Chen, Yang Liu, Guanhua Chen, Xin Jiang, Qun Liu

Shift-Att is an interpretation method that induces alignments from the attention weights of Transformer and does not require parameter update or architecture change.

Machine Translation Multi-Task Learning +2

Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERT

1 code implementation ACL 2020 Zhiyong Wu, Yun Chen, Ben Kao, Qun Liu

However, this approach of evaluating a language model is undermined by the uncertainty of the amount of knowledge that is learned by the probe itself.

Dependency Parsing Language Modelling +2

Dictionary-based Data Augmentation for Cross-Domain Neural Machine Translation

no code implementations6 Apr 2020 Wei Peng, Chongxuan Huang, Tian-Hao Li, Yun Chen, Qun Liu

Existing data augmentation approaches for neural machine translation (NMT) have predominantly relied on back-translating in-domain (IND) monolingual corpora.

Data Augmentation Machine Translation +2

Efficient Drone Mobility Support Using Reinforcement Learning

no code implementations21 Nov 2019 Yun Chen, Xingqin Lin, Talha Khan, Mohammad Mozaffari

Flying drones can be used in a wide range of applications and services from surveillance to package delivery.

Q-Learning reinforcement-learning +1

A General Framework for Adaptation of Neural Machine Translation to Simultaneous Translation

no code implementations Asian Chapter of the Association for Computational Linguistics 2020 Yun Chen, Liangyou Li, Xin Jiang, Xiao Chen, Qun Liu

Despite the success of neural machine translation (NMT), simultaneous neural machine translation (SNMT), the task of translating in real time before a full sentence has been observed, remains challenging due to the syntactic structure difference and simultaneity requirements.

Machine Translation NMT +2

Fitness Done Right: a Real-time Intelligent Personal Trainer for Exercise Correction

no code implementations30 Oct 2019 Yun Chen, Yiyue Chen, Zhengzhong Tu

Finally, key values for key features of the two poses are computed correspondingly in the pose error detection part, which helps give correction advice.

Controllable Data Synthesis Method for Grammatical Error Correction

no code implementations29 Sep 2019 Liner Yang, Chencheng Wang, Yun Chen, Yongping Du, Erhong Yang

We propose two data synthesis methods which can control the error rate and the ratio of error types on synthetic data.

Grammatical Error Correction

Incorporating Sememes into Chinese Definition Modeling

1 code implementation16 May 2019 Liner Yang, Cunliang Kong, Yun Chen, Yang Liu, Qinan Fan, Erhong Yang

To accomplish this task, we construct the Chinese Definition Modeling Corpus (CDM), which contains triples of word, sememes and the corresponding definition.

Meta-Learning for Low-Resource Neural Machine Translation

no code implementations EMNLP 2018 Jiatao Gu, Yong Wang, Yun Chen, Kyunghyun Cho, Victor O. K. Li

We frame low-resource translation as a meta-learning problem, and we learn to adapt to low-resource languages based on multilingual high-resource language tasks.

Low-Resource Neural Machine Translation Meta-Learning +3

A Stable and Effective Learning Strategy for Trainable Greedy Decoding

1 code implementation EMNLP 2018 Yun Chen, Victor O. K. Li, Kyunghyun Cho, Samuel R. Bowman

Beam search is a widely used approximate search strategy for neural network decoders, and it generally outperforms simple greedy decoding on tasks like machine translation.

Machine Translation Translation

Zero-Resource Neural Machine Translation with Multi-Agent Communication Game

no code implementations9 Feb 2018 Yun Chen, Yang Liu, Victor O. K. Li

While end-to-end neural machine translation (NMT) has achieved notable success in the past years in translating a handful of resource-rich language pairs, it still suffers from the data scarcity problem for low-resource language pairs and domains.

Image Captioning Machine Translation +2

A Teacher-Student Framework for Zero-Resource Neural Machine Translation

no code implementations ACL 2017 Yun Chen, Yang Liu, Yong Cheng, Victor O. K. Li

While end-to-end neural machine translation (NMT) has made remarkable progress recently, it still suffers from the data scarcity problem for low-resource language pairs and domains.

Machine Translation NMT +2

Cannot find the paper you are looking for? You can Submit a new open access paper.