Search Results for author: Jihyeon Roh

Found 2 papers, 0 papers with code

Unigram-Normalized Perplexity as a Language Model Performance Measure with Different Vocabulary Sizes

no code implementations26 Nov 2020 Jihyeon Roh, Sang-Hoon Oh, Soo-Young Lee

Although Perplexity is a widely used performance metric for language models, the values are highly dependent upon the number of words in the corpus and is useful to compare performance of the same corpus only.

Language Modelling

Hierarchical GPT with Congruent Transformers for Multi-Sentence Language Models

no code implementations18 Sep 2020 Jihyeon Roh, Huiseong Gim, Soo-Young Lee

First, we propose a hierarchical GPT which consists of three blocks, i. e., a sentence encoding block, a sentence generating block, and a sentence decoding block.

Dialogue Generation document understanding +4

Cannot find the paper you are looking for? You can Submit a new open access paper.