Text Generation

1454 papers with code • 167 benchmarks • 149 datasets

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task if more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Libraries

Use these libraries to find Text Generation models and implementations
10 papers
123,262
6 papers
205

ILLUMINER: Instruction-tuned Large Language Models as Few-shot Intent Classifier and Slot Filler

opengptx/illuminer 26 Mar 2024

State-of-the-art intent classification (IC) and slot filling (SF) methods often rely on data-intensive deep learning models, limiting their practicality for industry applications.

0
26 Mar 2024

ToXCL: A Unified Framework for Toxic Speech Detection and Explanation

nhathoang2002/toxcl 25 Mar 2024

This draws a unique need for unified frameworks that can effectively detect and explain implicit toxic speech.

1
25 Mar 2024

LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models

hiyouga/llama-efficient-tuning 20 Mar 2024

Efficient fine-tuning is vital for adapting large language models (LLMs) to downstream tasks.

14,921
20 Mar 2024

Dynamic Reward Adjustment in Multi-Reward Reinforcement Learning for Counselor Reflection Generation

michigannlp/dynaopt 20 Mar 2024

In this paper, we study the problem of multi-reward reinforcement learning to jointly optimize for multiple text qualities for natural language generation.

2
20 Mar 2024

Evaluating Named Entity Recognition: Comparative Analysis of Mono- and Multilingual Transformer Models on Brazilian Corporate Earnings Call Transcriptions

rsabilio/nereval-braziliancorporatetranscriptions 18 Mar 2024

By curating a comprehensive dataset comprising 384 transcriptions and leveraging weak supervision techniques for annotation, we evaluate the performance of monolingual models trained on Portuguese (BERTimbau and PTT5) and multilingual models (mBERT and mT5).

0
18 Mar 2024

ConvSDG: Session Data Generation for Conversational Search

fengranmark/convsdg 17 Mar 2024

Conversational search provides a more convenient interface for users to search by allowing multi-turn interaction with the search engine.

1
17 Mar 2024

DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers

nus-hpc-ai-lab/opendit 15 Mar 2024

Scaling large models with long sequences across applications like language generation, video generation and multimodal tasks requires efficient sequence parallelism.

939
15 Mar 2024

DRAGIN: Dynamic Retrieval Augmented Generation based on the Real-time Information Needs of Large Language Models

oneal2000/dragin 15 Mar 2024

Our framework is specifically designed to make decisions on when and what to retrieve based on the LLM's real-time information needs during the text generation process.

9
15 Mar 2024

Whose Side Are You On? Investigating the Political Stance of Large Language Models

smith-pit/llm-partisan-bias 15 Mar 2024

Large Language Models (LLMs) have gained significant popularity for their application in various everyday tasks such as text generation, summarization, and information retrieval.

0
15 Mar 2024

Generative Pretrained Structured Transformers: Unsupervised Syntactic Language Models at Scale

alipay/StructuredLM_RTDT 13 Mar 2024

A syntactic language model (SLM) incrementally generates a sentence with its syntactic tree in a left-to-right manner.

59
13 Mar 2024