IndicGLUE (Indic General Language Understanding Evaluation Benchmark)

Introduced by Kakwani et al. in IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages

We now introduce IndicGLUE, the Indic General Language Understanding Evaluation Benchmark, which is a collection of various NLP tasks as de- scribed below. The goal is to provide an evaluation benchmark for natural language understanding ca- pabilities of NLP models on diverse tasks and mul- tiple Indian languages.

Homepage

Benchmarks

Add a new result Link an existing benchmark

Task	Dataset Variant	Best Model
Sentiment Analysis	IITP Product Reviews Sentiment	CalBERT
Sentiment Analysis	IITP Movie Reviews Sentiment	xlmindic-base-uniscript
Multiple Choice Question Answering (MCQA)	IndicGLUE WSTP Pa	xlmindic-base-uniscript