Imitation Learning

508 papers with code • 0 benchmarks • 18 datasets

Imitation Learning is a framework for learning a behavior policy from demonstrations. Usually, demonstrations are presented in the form of state-action trajectories, with each pair indicating the action to take at the state being visited. In order to learn the behavior policy, the demonstrated actions are usually utilized in two ways. The first, known as Behavior Cloning (BC), treats the action as the target label for each state, and then learns a generalized mapping from states to actions in a supervised manner. Another way, known as Inverse Reinforcement Learning (IRL), views the demonstrated actions as a sequence of decisions, and aims at finding a reward/cost function under which the demonstrated decisions are optimal.

Finally, a newer methodology, Inverse Q-Learning aims at directly learning Q-functions from expert data, implicitly representing rewards, under which the optimal policy can be given as a Boltzmann distribution similar to soft Q-learning

Source: Learning to Imitate

Libraries

Use these libraries to find Imitation Learning models and implementations

ODICE: Revealing the Mystery of Distribution Correction Estimation via Orthogonal-gradient Update

maoliyuan/odice-pytorch 1 Feb 2024

To resolve this issue, we propose a simple yet effective modification that projects the backward gradient onto the normal plane of the forward gradient, resulting in an orthogonal-gradient update, a new learning rule for DICE-based methods.

13
01 Feb 2024

Expert Proximity as Surrogate Rewards for Single Demonstration Imitation Learning

stanl1y/tdil 1 Feb 2024

In this paper, we focus on single-demonstration imitation learning (IL), a practical approach for real-world applications where obtaining numerous expert demonstrations is costly or infeasible.

0
01 Feb 2024

LeTO: Learning Constrained Visuomotor Policy with Differentiable Trajectory Optimization

zhengtongxu/leto 30 Jan 2024

This paper introduces LeTO, a method for learning constrained visuomotor policy via differentiable trajectory optimization.

4
30 Jan 2024

Harnessing Network Effect for Fake News Mitigation: Selecting Debunkers via Self-Imitation Learning

xxfwin/nagasil 28 Jan 2024

This study aims to minimize the influence of fake news on social networks by deploying debunkers to propagate true news.

0
28 Jan 2024

States as Strings as Strategies: Steering Language Models with Game-Theoretic Solvers

google-deepmind/open_spiel 24 Jan 2024

A suitable model of the players, strategies, and payoffs associated with linguistic interactions (i. e., a binding to the conventional symbolic logic of game theory) would enable existing game-theoretic algorithms to provide strategic solutions in the space of language.

3,970
24 Jan 2024

LangProp: A code optimization framework using Language Models applied to driving

shuishida/langprop 18 Jan 2024

LangProp is a framework for iteratively optimizing code generated by large language models (LLMs) in a supervised/reinforcement learning setting.

19
18 Jan 2024

LPAC: Learnable Perception-Action-Communication Loops with Applications to Coverage Control

kumarrobotics/coveragecontrol 10 Jan 2024

Coverage control is the problem of navigating a robot swarm to collaboratively monitor features or a phenomenon of interest not known a priori.

3
10 Jan 2024

SwapTransformer: highway overtaking tactical planner model via imitation learning on OSHA dataset

vwieccresearch/swaptransformer 2 Jan 2024

In particular, this paper aims to improve the Travel Assist feature for automatic overtaking and lane changes on highways.

3
02 Jan 2024

LHManip: A Dataset for Long-Horizon Language-Grounded Manipulation Tasks in Cluttered Tabletop Environments

fedeceola/lhmanip 19 Dec 2023

Instructing a robot to complete an everyday task within our homes has been a long-standing challenge for robotics.

3
19 Dec 2023

DiffAIL: Diffusion Adversarial Imitation Learning

ml-group-sdu/diffail 11 Dec 2023

To address this issue, we propose a method named diffusion adversarial imitation learning (DiffAIL), which introduces the diffusion model into the AIL framework.

11
11 Dec 2023