About

Accuracy metrics analysis to identify applicability scope and discuss explainability and interpretability of the resulting values

Benchmarks

You can find evaluation results in the subtasks. You can also submitting evaluation metrics for this task.

Subtasks

Greatest papers with code

A Survey on Performance Metrics for Object-Detection Algorithms

21 Jul 2020rafaelpadilla/Object-Detection-Metrics

The lack of consensus in different works and AP implementations is a problem faced by the academic and scientific communities.

ACCURACY METRICS OBJECT DETECTION

Adversarial Examples for Evaluating Reading Comprehension Systems

EMNLP 2017 makcedward/nlpaug

Standard accuracy metrics indicate that reading comprehension systems are making rapid progress, but the extent to which these systems truly understand language remains unclear.

ACCURACY METRICS QUESTION ANSWERING READING COMPREHENSION

Speech Commands: A Dataset for Limited-Vocabulary Speech Recognition

9 Apr 2018TomVeniat/SANAS

Describes an audio dataset of spoken words designed to help train and evaluate keyword spotting systems.

ACCURACY METRICS KEYWORD SPOTTING SPEECH RECOGNITION

Dilated deeply supervised networks for hippocampus segmentation in MRI

20 Mar 2019satyakees/FaultNet

Tissue loss in the hippocampi has been heavily correlated with the progression of Alzheimer's Disease (AD).

ACCURACY METRICS SEMANTIC SEGMENTATION

Efficient Neural Network Compression

CVPR 2019 Hyeji-Kim/ENC

The better accuracy and complexity compromise, as well as the extremely fast speed of our method makes it suitable for neural network compression.

ACCURACY METRICS NEURAL NETWORK COMPRESSION

Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark

18 Aug 2020jeslago/epftoolbox

While the field of electricity price forecasting has benefited from plenty of contributions in the last two decades, it arguably lacks a rigorous approach to evaluating new predictive algorithms.

ACCURACY METRICS

QAInfomax: Learning Robust Question Answering System by Mutual Information Maximization

IJCNLP 2019 MiuLab/QAInfomax

Standard accuracy metrics indicate that modern reading comprehension systems have achieved strong performance in many question answering datasets.

ACCURACY METRICS QUESTION ANSWERING READING COMPREHENSION

An Attention Mechanism for Musical Instrument Recognition

9 Jul 2019SiddGururani/AttentionMIC

While the automatic recognition of musical instruments has seen significant progress, the task is still considered hard for music featuring multiple instruments as opposed to single instrument recordings.

ACCURACY METRICS INSTRUMENT RECOGNITION

FastSal: a Computationally Efficient Network for Visual Saliency Prediction

25 Aug 2020feiyanhu/FastSal

This paper focuses on the problem of visual saliency prediction, predicting regions of an image that tend to attract human visual attention, under a constrained computational budget.

ACCURACY METRICS SALIENCY PREDICTION TRANSFER LEARNING