Search Results for author: Letian Peng

Found 13 papers, 7 papers with code

Incubating Text Classifiers Following User Instruction with Nothing but LLM

no code implementations16 Apr 2024 Letian Peng, Jingbo Shang

In this paper, we aim to generate text classification data given arbitrary class definitions (i. e., user instruction), so one can train a small text classifier without any human annotation or raw corpus.

Prompt Engineering text-classification +1

Learn from Failure: Fine-Tuning LLMs with Trial-and-Error Data for Intuitionistic Propositional Logic Proving

no code implementations10 Apr 2024 Chenyang An, Zhibo Chen, Qihao Ye, Emily First, Letian Peng, Jiayun Zhang, Zihan Wang, Sorin Lerner, Jingbo Shang

Recent advances in Automated Theorem Proving have shown the effectiveness of leveraging a (large) language model that generates tactics (i. e. proof steps) to search through proof states.

Automated Theorem Proving Language Modelling +1

MetaIE: Distilling a Meta Model from LLM for All Kinds of Information Extraction Tasks

1 code implementation30 Mar 2024 Letian Peng, Zilong Wang, Feng Yao, Zihan Wang, Jingbo Shang

We construct the distillation dataset via sampling sentences from language model pre-training datasets (e. g., OpenWebText in our implementation) and prompting an LLM to identify the typed spans of "important information".

Language Modelling named-entity-recognition +2

Less than One-shot: Named Entity Recognition via Extremely Weak Supervision

1 code implementation6 Nov 2023 Letian Peng, Zihan Wang, Jingbo Shang

We study the named entity recognition (NER) problem under the extremely weak supervision (XWS) setting, where only one example entity per type is given in a context-free way.

named-entity-recognition Named Entity Recognition +1

EmojiLM: Modeling the New Emoji Language

1 code implementation3 Nov 2023 Letian Peng, Zilong Wang, Hang Liu, Zihan Wang, Jingbo Shang

With the rapid development of the internet, online social media welcomes people with different backgrounds through its diverse content.

Language Modelling Large Language Model

Generating Efficient Training Data via LLM-based Attribute Manipulation

1 code implementation14 Jul 2023 Letian Peng, Yuwei Zhang, Jingbo Shang

In this paper, we propose a novel method, Chain-of-Thoughts Attribute Manipulation (CoTAM), to guide few-shot learning by carefully crafted data from Large Language Models (LLMs).

Attribute Few-Shot Learning +3

Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning

no code implementations23 Aug 2022 Letian Peng, Zuchao Li, Hai Zhao

In detail, it works on PLMs according to the Replaced Token Detection (RTD) pre-training objective in ELECTRA, in which the corruption detection objective reflects the confidence on contextual integrity that is more relevant to commonsense reasoning than existing probability.

Language Modelling Question Answering +1

Semantics-Preserved Distortion for Personal Privacy Protection in Information Management

no code implementations4 Jan 2022 Jiajia Li, Letian Peng, Ping Wang, Zuchao Li, Xueyi Li, Hai Zhao

As the model training on information from users is likely to invade personal privacy, many methods have been proposed to block the learning and memorizing of the sensitive data in raw texts.

Attribute Constituency Parsing +6

Contextualized Semantic Distance between Highly Overlapped Texts

1 code implementation4 Oct 2021 Letian Peng, Zuchao Li, Hai Zhao

Overlapping frequently occurs in paired texts in natural language processing tasks like text editing and semantic similarity evaluation.

Domain Adaptation Language Modelling +8

Sparse Fuzzy Attention for Structured Sentiment Analysis

no code implementations14 Sep 2021 Letian Peng, Zuchao Li, Hai Zhao

Attention scorers have achieved success in parsing tasks like semantic and syntactic dependency parsing.

Dependency Parsing Sentiment Analysis

Cannot find the paper you are looking for? You can Submit a new open access paper.