Reading Subtext: Evaluating Large Language Models on Short Story Summarization with Writers

1 code implementation • 2 Mar 2024 • Melanie Subbiah, Sean Zhang, Lydia B. Chilton, Kathleen McKeown

We evaluate recent Large language Models (LLMs) on the challenging task of summarizing short stories, which can be lengthy, and include nuanced subtext or scrambled timelines.

Toward Unsupervised Outlier Model Selection

1 code implementation • 3 Nov 2022 • Yue Zhao, Sean Zhang, Leman Akoglu

At its core, ELECT is based on meta-learning; transferring prior knowledge (e. g. model performance) on historical datasets that are similar to the new one to facilitate UOMS.

Meta-Learning Model Selection +1