Search Results for author: Zheng Du

Found 6 papers, 1 papers with code

CML: A Contrastive Meta Learning Method to Estimate Human Label Confidence Scores and Reduce Data Collection Cost

no code implementations ECNLP (ACL) 2022 Bo Dong, Yiyi Wang, Hanbo Sun, Yunji Wang, Alireza Hashemi, Zheng Du

In this paper, we propose a contrastive meta-learning framework (CML) to address the challenges introduced by noisy annotated data, specifically in the context of natural language processing.

Meta-Learning

Efficient Toxic Content Detection by Bootstrapping and Distilling Large Language Models

no code implementations13 Dec 2023 Jiang Zhang, Qiong Wu, Yiming Xu, Cheng Cao, Zheng Du, Konstantinos Psounis

Furthermore, student LMs fine-tuned with rationales extracted via DToT outperform baselines on all datasets with up to 16. 9\% accuracy improvement, while being more than 60x smaller than conventional LLMs.

In-Context Learning

Human Transcription Quality Improvement

1 code implementation24 Sep 2023 Jian Gao, Hanbo Sun, Cheng Cao, Zheng Du

We collect and release LibriCrowd - a large-scale crowdsourced dataset of audio transcriptions on 100 hours of English speech.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1

APAM: Adaptive Pre-training and Adaptive Meta Learning in Language Model for Noisy Labels and Long-tailed Learning

no code implementations6 Feb 2023 Sunyi Chi, Bo Dong, Yiming Xu, Zhenyu Shi, Zheng Du

Lastly, our sensitive analysis emphasizes the capability of the proposed framework to handle the long-tailed problem and mitigate the negative impact of noisy labels.

Contrastive Learning Language Modelling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.