Browse SoTA > Methodology > Structured Prediction

Structured Prediction

109 papers with code · Methodology

Structured Prediction is an area of machine learning focusing on representations of spaces with combinatorial structure, and algorithms for inference and parameter estimation over these structures. Core methods include both tractable exact approaches like dynamic programming and spanning tree algorithms as well as heuristic techniques such as linear programming relaxations and greedy search.

Source: Torch-Struct: Deep Structured Prediction Library

Benchmarks

Greatest papers with code

The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables

2 Nov 2016tensorflow/models

The essence of the trick is to refactor each stochastic node into a differentiable function of its parameters and a random variable with fixed distribution.

DENSITY ESTIMATION STRUCTURED PREDICTION

Convolutional Pose Machines

CVPR 2016 CMU-Perceptual-Computing-Lab/openpose

Pose Machines provide a sequential prediction framework for learning rich implicit spatial models.

3D HUMAN POSE ESTIMATION STRUCTURED PREDICTION

On the Discrepancy between Density Estimation and Sequence Generation

17 Feb 2020tensorflow/tensor2tensor

In this paper, by comparing several density estimators on five machine translation tasks, we find that the correlation between rankings of models based on log-likelihood and BLEU varies significantly depending on the range of the model families being compared.

DENSITY ESTIMATION LATENT VARIABLE MODELS MACHINE TRANSLATION STRUCTURED PREDICTION

Classical Structured Prediction Losses for Sequence to Sequence Learning

NAACL 2018 pytorch/fairseq

There has been much recent work on training neural attention models at the sequence-level using either reinforcement learning-style methods or by optimizing the beam.

ABSTRACTIVE TEXT SUMMARIZATION MACHINE TRANSLATION STRUCTURED PREDICTION

The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Models

12 Aug 2020PAIR-code/lit

We present the Language Interpretability Tool (LIT), an open-source platform for visualization and understanding of NLP models.

SENTIMENT ANALYSIS STRUCTURED PREDICTION TEXT GENERATION

The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding

ACL 2020 namisan/mt-dnn

We present MT-DNN, an open-source natural language understanding (NLU) toolkit that makes it easy for researchers and developers to train customized deep learning models.

MULTI-TASK LEARNING NATURAL LANGUAGE UNDERSTANDING STRUCTURED PREDICTION

Torch-Struct: Deep Structured Prediction Library

ACL 2020 harvardnlp/pytorch-struct

The literature on structured prediction for NLP describes a rich collection of distributions and algorithms over sequences, segmentations, alignments, and trees; however, these algorithms are difficult to utilize in deep learning frameworks.

STRUCTURED PREDICTION

Torch-Struct: Deep Structured Prediction Library

3 Feb 2020harvardnlp/pytorch-struct

The literature on structured prediction for NLP describes a rich collection of distributions and algorithms over sequences, segmentations, alignments, and trees; however, these algorithms are difficult to utilize in deep learning frameworks.

STRUCTURED PREDICTION

A Structured Prediction Approach for Generalization in Cooperative Multi-Agent Reinforcement Learning

NeurIPS 2019 TorchCraft/TorchCraftAI

While centralized reinforcement learning methods can optimally solve small MAC instances, they do not scale to large problems and they fail to generalize to scenarios different from those seen during training.

MULTI-AGENT REINFORCEMENT LEARNING STARCRAFT STRUCTURED PREDICTION