Search Results for author: Divyanshu Aggarwal

Found 8 papers, 2 papers with code

Fine-tuning Distributional Semantic Models for Closely-Related Languages

no code implementations EACL (VarDial) 2021 Kushagra Bhatia, Divyanshu Aggarwal, Ashwini Vaidya

In this paper we compare the performance of three models: SGNS (skip-gram negative sampling) and augmented versions of SVD (singular value decomposition) and PPMI (Positive Pointwise Mutual Information) on a word similarity task.

Word Similarity

XInfoTabS: Evaluating Multilingual Tabular Natural Language Inference

no code implementations FEVER (ACL) 2022 Bhavnick Minhas, Anant Shankhdhar, Vivek Gupta, Divyanshu Aggarwal, Shuo Zhang

In this paper, we use machine translation methods to construct a multilingual tabular NLI dataset, namely XINFOTABS, which expands the English tabular NLI dataset of INFOTABS to ten diverse languages.

Machine Translation Natural Language Inference +1

MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models

no code implementations15 Jan 2024 Divyanshu Aggarwal, Ashutosh Sathe, Ishaan Watts, Sunayana Sitaram

Prior work on multilingual evaluation has shown that there is a large gap between the performance of LLMs on English and other languages.

MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks

no code implementations13 Nov 2023 Sanchit Ahuja, Divyanshu Aggarwal, Varun Gumma, Ishaan Watts, Ashutosh Sathe, Millicent Ochieng, Rishav Hada, Prachi Jain, Maxamed Axmed, Kalika Bali, Sunayana Sitaram

We also perform a study on data contamination and find that several models are likely to be contaminated with multilingual evaluation benchmarks, necessitating approaches to detect and handle contamination while assessing the multilingual performance of LLMs.

Benchmarking

Evaluating Inter-Bilingual Semantic Parsing for Indian Languages

1 code implementation25 Apr 2023 Divyanshu Aggarwal, Vivek Gupta, Anoop Kunchukuttan

Despite significant progress in Natural Language Generation for Indian languages (IndicNLP), there is a lack of datasets around complex structured tasks such as semantic parsing.

Semantic Parsing Text Generation +1

A Review of Deep Learning Techniques for Protein Function Prediction

no code implementations27 Oct 2022 Divyanshu Aggarwal, Yasha Hasija

Deep Learning and big data have shown tremendous success in bioinformatics and computational biology in recent years; artificial intelligence methods have also significantly contributed in the task of protein function classification.

Protein Function Prediction

IndicXNLI: Evaluating Multilingual Inference for Indian Languages

1 code implementation19 Apr 2022 Divyanshu Aggarwal, Vivek Gupta, Anoop Kunchukuttan

While Indic NLP has made rapid advances recently in terms of the availability of corpora and pre-trained models, benchmark datasets on standard NLU tasks are limited.

Cross-Lingual Transfer Machine Translation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.