SOCIALITE-LLAMA: An Instruction-Tuned Model for Social Scientific Tasks

no code implementations • 3 Feb 2024 • Gourab Dey, Adithya V Ganesan, Yash Kumar Lal, Manal Shah, Shreyashee Sinha, Matthew Matero, Salvatore Giorgi, Vivek Kulkarni, H. Andrew Schwartz

Social science NLP tasks, such as emotion or humor detection, are required to capture the semantics along with the implicit pragmatics from text, often with limited amounts of training data.

Humor Detection Reading Comprehension

Evaluating Paraphrastic Robustness in Textual Entailment Models

no code implementations • 29 Jun 2023 • Dhruv Verma, Yash Kumar Lal, Shreyashee Sinha, Benjamin Van Durme, Adam Poliak

We present PaRTE, a collection of 1, 126 pairs of Recognizing Textual Entailment (RTE) examples to evaluate whether models are robust to paraphrasing.

Natural Language Inference RTE