Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models

1 code implementation • 23 Apr 2024 • Mihir Parmar, Nisarg Patel, Neeraj Varshney, Mutsumi Nakamura, Man Luo, Santosh Mashetty, Arindam Mitra, Chitta Baral

Existing work investigating this reasoning ability of LLMs has focused only on a couple of inference rules (such as modus ponens and modus tollens) of propositional and first-order logic.

Logical Reasoning Question Answering

Enhancing Financial Data Visualization for Investment Decision-Making

no code implementations • 9 Dec 2023 • Nisarg Patel, Harmit Shah, Kishan Mewada

Navigating the intricate landscape of financial markets requires adept forecasting of stock price movements.

Data Visualization Decision Making +3

Can NLP Models 'Identify', 'Distinguish', and 'Justify' Questions that Don't have a Definitive Answer?

no code implementations • 8 Sep 2023 • Ayushi Agarwal, Nisarg Patel, Neeraj Varshney, Mihir Parmar, Pavan Mallina, Aryan Bhavin Shah, Srihari Raju Sangaraju, Tirth Patel, Nihar Thakkar, Chitta Baral

Though state-of-the-art (SOTA) NLP systems have achieved remarkable performance on a variety of language understanding tasks, they primarily focus on questions that have a correct and a definitive answer.

Can NLP Models Correctly Reason Over Contexts that Break the Common Assumptions?

no code implementations • 20 May 2023 • Neeraj Varshney, Mihir Parmar, Nisarg Patel, Divij Handa, Sayantan Sarkar, Man Luo, Chitta Baral

Can state-of-the-art NLP models correctly reason over the contexts of such scenarios?