Search Results for author: Davood Rafiei

Found 10 papers, 6 papers with code

TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table Decomposition

1 code implementation15 Apr 2024 Md Mahadi Hasan Nahid, Davood Rafiei

Table reasoning is a challenging task that requires understanding both natural language questions and structured tabular data.

Natural Language Understanding Text-To-SQL

SQL-Encoder: Improving NL2SQL In-Context Learning Through a Context-Aware Encoder

no code implementations24 Mar 2024 Mohammadreza Pourreza, Davood Rafiei, Yuxi Feng, Raymond Li, Zhenan Fan, Weiwei Zhang

Furthermore, compared to these competitive models, our proposed encoder enhances the downstream performance of NL2SQL models in 1-shot in-context learning scenarios by 1-2\% for GPT-3. 5-turbo, 4-8\% for CodeLlama-7B, and 2-3\% for CodeLlama-13B.

In-Context Learning

DTS-SQL: Decomposed Text-to-SQL with Small Large Language Models

no code implementations2 Feb 2024 Mohammadreza Pourreza, Davood Rafiei

Leading models for the text-to-SQL task heavily rely on proprietary Large Language Models (LLMs), posing concerns over data privacy.

Text-To-SQL

Evaluating Cross-Domain Text-to-SQL Models and Benchmarks

no code implementations27 Oct 2023 Mohammadreza Pourreza, Davood Rafiei

In this paper, we conduct an extensive study of several prominent cross-domain text-to-SQL benchmarks and re-evaluate some of the top-performing models within these benchmarks, by both manually evaluating the SQL queries and rewriting them in equivalent expressions.

Natural Language Queries Text-To-SQL

Performance Prediction for Multi-hop Questions

no code implementations12 Aug 2023 Mohammadreza Samadi, Davood Rafiei

We study the problem of Query Performance Prediction (QPP) for open-domain multi-hop Question Answering (QA), where the task is to estimate the difficulty of evaluating a multi-hop question over a corpus.

Multi-hop Question Answering Question Answering +1

Evaluating Open-Domain Question Answering in the Era of Large Language Models

1 code implementation11 May 2023 Ehsan Kamalloo, Nouha Dziri, Charles L. A. Clarke, Davood Rafiei

The recent success of large language models (LLMs) for QA aggravates lexical matching failures since candidate answers become longer, thereby making matching with the gold answers even more challenging.

Open-Domain Question Answering

DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction

1 code implementation NeurIPS 2023 Mohammadreza Pourreza, Davood Rafiei

In particular, we show that breaking down the generation problem into sub-problems and feeding the solutions of those sub-problems into LLMs can be an effective approach for significantly improving their performance.

In-Context Learning Text-To-SQL

On the Role of Reviewer Expertise in Temporal Review Helpfulness Prediction

1 code implementation22 Feb 2023 Mir Tafseer Nayeem, Davood Rafiei

Helpful reviews have been essential for the success of e-commerce services, as they help customers make quick purchase decisions and benefit the merchants in their sales.

A Coherent Unsupervised Model for Toponym Resolution

1 code implementation4 May 2018 Ehsan Kamalloo, Davood Rafiei

The evaluation shows that our method outperforms the unsupervised technique as well as Reuters OpenCalais and Google Cloud Natural Language API on all three corpora; also, our method shows a performance close to that of the state-of-the-art supervised method and outperforms it when the test data has 40% or more toponyms that are not seen in the training data.

Toponym Resolution

Cannot find the paper you are looking for? You can Submit a new open access paper.