Search Results for author: Ke Zeng

Found 3 papers, 2 papers with code

One-Shot Sensitivity-Aware Mixed Sparsity Pruning for Large Language Models

1 code implementation14 Oct 2023 Hang Shao, Bei Liu, Bo Xiao, Ke Zeng, Guanglu Wan, Yanmin Qian

Various Large Language Models~(LLMs) from the Generative Pretrained Transformer(GPT) family have achieved outstanding performances in a wide range of text generation tasks.

Quantization Text Generation

A Task-oriented Dialog Model with Task-progressive and Policy-aware Pre-training

1 code implementation1 Oct 2023 Lucen Zhong, Hengtong Lu, Caixia Yuan, Xiaojie Wang, Jiashen Sun, Ke Zeng, Guanglu Wan

A global policy consistency task is designed to capture the multi-turn dialog policy sequential relation, and an act-based contrastive learning task is designed to capture similarities among samples with the same dialog policy.

Contrastive Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.