1 code implementation • 15 Apr 2024 • Md Mahadi Hasan Nahid, Davood Rafiei
Table reasoning is a challenging task that requires understanding both natural language questions and structured tabular data.
no code implementations • 24 Mar 2024 • Mohammadreza Pourreza, Davood Rafiei, Yuxi Feng, Raymond Li, Zhenan Fan, Weiwei Zhang
Furthermore, compared to these competitive models, our proposed encoder enhances the downstream performance of NL2SQL models in 1-shot in-context learning scenarios by 1-2\% for GPT-3. 5-turbo, 4-8\% for CodeLlama-7B, and 2-3\% for CodeLlama-13B.
no code implementations • 2 Feb 2024 • Mohammadreza Pourreza, Davood Rafiei
Leading models for the text-to-SQL task heavily rely on proprietary Large Language Models (LLMs), posing concerns over data privacy.
no code implementations • 27 Oct 2023 • Mohammadreza Pourreza, Davood Rafiei
In this paper, we conduct an extensive study of several prominent cross-domain text-to-SQL benchmarks and re-evaluate some of the top-performing models within these benchmarks, by both manually evaluating the SQL queries and rewriting them in equivalent expressions.
no code implementations • 12 Aug 2023 • Mohammadreza Samadi, Davood Rafiei
We study the problem of Query Performance Prediction (QPP) for open-domain multi-hop Question Answering (QA), where the task is to estimate the difficulty of evaluating a multi-hop question over a corpus.
1 code implementation • 11 May 2023 • Ehsan Kamalloo, Nouha Dziri, Charles L. A. Clarke, Davood Rafiei
The recent success of large language models (LLMs) for QA aggravates lexical matching failures since candidate answers become longer, thereby making matching with the gold answers even more challenging.
1 code implementation • NeurIPS 2023 • Mohammadreza Pourreza, Davood Rafiei
In particular, we show that breaking down the generation problem into sub-problems and feeding the solutions of those sub-problems into LLMs can be an effective approach for significantly improving their performance.
Ranked #3 on Text-To-SQL on spider
1 code implementation • 22 Feb 2023 • Mir Tafseer Nayeem, Davood Rafiei
Helpful reviews have been essential for the success of e-commerce services, as they help customers make quick purchase decisions and benefit the merchants in their sales.
1 code implementation • ACM International Conference on Information & Knowledge Management (CIKM) 2022 • Mehdi Akbarian Rastaghi, Ehsan Kamalloo, Davood Rafiei
The paradigm of fine-tuning Pre-trained Language Models (PLMs) has been successful in Entity Matching (EM).
Ranked #3 on Entity Resolution on Amazon-Google
1 code implementation • 4 May 2018 • Ehsan Kamalloo, Davood Rafiei
The evaluation shows that our method outperforms the unsupervised technique as well as Reuters OpenCalais and Google Cloud Natural Language API on all three corpora; also, our method shows a performance close to that of the state-of-the-art supervised method and outperforms it when the test data has 40% or more toponyms that are not seen in the training data.