Search Results for author: Prachi Jain

Found 10 papers, 6 papers with code

MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks

no code implementations13 Nov 2023 Sanchit Ahuja, Divyanshu Aggarwal, Varun Gumma, Ishaan Watts, Ashutosh Sathe, Millicent Ochieng, Rishav Hada, Prachi Jain, Maxamed Axmed, Kalika Bali, Sunayana Sitaram

We also perform a study on data contamination and find that several models are likely to be contaminated with multilingual evaluation benchmarks, necessitating approaches to detect and handle contamination while assessing the multilingual performance of LLMs.

Benchmarking

MEGA: Multilingual Evaluation of Generative AI

1 code implementation22 Mar 2023 Kabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng, Krithika Ramesh, Prachi Jain, Akshay Nambi, Tanuja Ganu, Sameer Segal, Maxamed Axmed, Kalika Bali, Sunayana Sitaram

Most studies on generative LLMs have been restricted to English and it is unclear how capable these models are at understanding and generating text in other languages.

Benchmarking

Knowledge Base Completion: Baseline strikes back (Again)

1 code implementation2 May 2020 Prachi Jain, Sushant Rathi, Mausam, Soumen Chakrabarti

Most existing methods train with a small number of negative samples for each positive instance in these datasets to save computational costs.

Knowledge Base Completion Knowledge Base Population +2

Type-Sensitive Knowledge Base Inference Without Explicit Type Supervision

1 code implementation ACL 2018 Prachi Jain, Pankaj Kumar, {Mausam}, Soumen Chakrabarti

State-of-the-art knowledge base completion (KBC) models predict a score for every known or unknown fact via a latent factorization over entity and relation embeddings.

Entity Typing Knowledge Base Completion +6

Cannot find the paper you are looking for? You can Submit a new open access paper.