Search Results for author: Sayontan Ghosh

Found 4 papers, 3 papers with code

SpecNFS: A Challenge Dataset Towards Extracting Formal Models from Natural Language Specifications

1 code implementation LREC 2022 Sayontan Ghosh, Amanpreet Singh, Alex Merenstein, Wei Su, Scott A. Smolka, Erez Zadok, Niranjan Balasubramanian

Evaluations show that even when using a state-of-the-art language model, there is significant room for improvement, with the best models achieving an F1 score of only 60. 5 and 33. 3 in the named-entity-recognition and dependency-link-prediction sub-tasks, respectively.

Dependency Parsing Domain Adaptation +7

PASTA: A Dataset for Modeling Participant States in Narratives

no code implementations31 Jul 2022 Sayontan Ghosh, Mahnaz Koupaee, Isabella Chen, Francis Ferraro, Nathanael Chambers, Niranjan Balasubramanian

This dataset contains inferable participant states; a counterfactual perturbation to each state; and the changes to the story that would be necessary if the counterfactual were true.

Benchmarking Common Sense Reasoning +1

Cannot find the paper you are looking for? You can Submit a new open access paper.