TASK	DATASET	MODEL	METRIC NAME	METRIC VALUE	GLOBAL RANK
Atari Games	Atari 2600 Alien	R2D2	Score	229496.9	# 4
Atari Games	Atari 2600 Amidar	R2D2	Score	29321.4	# 2
Atari Games	Atari 2600 Assault	R2D2	Score	108197.0	# 2
Atari Games	Atari 2600 Asterix	R2D2	Score	999153.3	# 2
Atari Games	Atari 2600 Asteroids	R2D2	Score	357867.7	# 5
Atari Games	Atari 2600 Atlantis	R2D2	Score	1620764.0	# 6
Atari Games	Atari 2600 Bank Heist	R2D2	Score	24235.9	# 2
Atari Games	Atari 2600 Battle Zone	R2D2	Score	751880.0	# 4
Atari Games	Atari 2600 Beam Rider	R2D2	Score	188257.4	# 5
Atari Games	Atari 2600 Berzerk	R2D2	Score	53318.7	# 5
Atari Games	Atari 2600 Bowling	R2D2	Score	219.5	# 4
Atari Games	Atari 2600 Boxing	R2D2	Score	98.5	# 20
Atari Games	Atari 2600 Breakout	R2D2	Score	837.7	# 8
Atari Games	Atari 2600 Centipede	R2D2	Score	599140.3	# 5
Atari Games	Atari 2600 Chopper Command	R2D2	Score	986652.0	# 6
Atari Games	Atari 2600 Crazy Climber	R2D2	Score	366690.7	# 3
Atari Games	Atari 2600 Defender	R2D2	Score	665792.0	# 7
Atari Games	Atari 2600 Demon Attack	R2D2	Score	140002.3	# 8
Atari Games	Atari 2600 Double Dunk	R2D2	Score	23.7	# 8
Atari Games	Atari 2600 Enduro	R2D2	Score	2372.7	# 6
Atari Games	Atari 2600 Fishing Derby	R2D2	Score	85.8	# 3
Atari Games	Atari 2600 Freeway	R2D2	Score	32.5	# 25
Atari Games	Atari 2600 Frostbite	R2D2	Score	315456.4	# 4
Atari Games	Atari 2600 Gopher	R2D2	Score	124776.3	# 4
Atari Games	Atari 2600 Gravitar	R2D2	Score	15680.7	# 2
Atari Games	Atari 2600 HERO	R2D2	Score	39537.1	# 3
Atari Games	Atari 2600 Ice Hockey	R2D2	Score	79.3	# 2
Atari Games	Atari 2600 James Bond	R2D2	Score	25354.0	# 10
Atari Games	Atari 2600 Kangaroo	R2D2	Score	14130.7	# 13
Atari Games	Atari 2600 Krull	R2D2	Score	218448.1	# 4
Atari Games	Atari 2600 Kung-Fu Master	R2D2	Score	233413.3	# 3
Atari Games	Atari 2600 Montezuma's Revenge	R2D2	Score	2061.3	# 18
Atari Games	Atari 2600 Ms. Pacman	R2D2	Score	42281.7	# 4
Atari Games	Atari 2600 Name This Game	R2D2	Score	58182.7	# 3
Atari Games	Atari 2600 Phoenix	R2D2	Score	864020.0	# 6
Atari Games	Atari 2600 Pitfall!	R2D2	Score	0.0	# 4
Atari Games	Atari 2600 Pong	R2D2	Score	21.0	# 1
Atari Games	Atari 2600 Private Eye	R2D2	Score	5322.7	# 13
Atari Games	Atari 2600 Q*Bert	R2D2	Score	408850.0	# 3
Atari Games	Atari 2600 River Raid	R2D2	Score	45632.1	# 5
Atari Games	Atari 2600 Road Runner	R2D2	Score	599246.7	# 5
Atari Games	Atari 2600 Robotank	R2D2	Score	100.4	# 7
Atari Games	Atari 2600 Seaquest	R2D2	Score	999996.7	# 4
Atari Games	Atari 2600 Skiing	R2D2	Score	-30021.7	# 3
Atari Games	Atari 2600 Solaris	R2D2	Score	3787.2	# 15
Atari Games	Atari 2600 Space Invaders	R2D2	Score	43223.4	# 10
Atari Games	Atari 2600 Star Gunner	R2D2	Score	717344.0	# 2
Atari Games	Atari 2600 Surround	R2D2	Score	9.9	# 3
Atari Games	Atari 2600 Tennis	R2D2	Score	-0.1	# 29
Atari Games	Atari 2600 Time Pilot	R2D2	Score	445377.3	# 3
Atari Games	Atari 2600 Tutankham	R2D2	Score	395.3	# 6
Atari Games	Atari 2600 Up and Down	R2D2	Score	589226.9	# 8
Atari Games	Atari 2600 Venture	R2D2	Score	1970.7	# 8
Atari Games	Atari 2600 Video Pinball	R2D2	Score	999383.2	# 1
Atari Games	Atari 2600 Wizard of Wor	R2D2	Score	144362.7	# 3
Atari Games	Atari 2600 Yars Revenge	R2D2	Score	995048.4	# 2
Atari Games	Atari 2600 Zaxxon	R2D2	Score	224910.7	# 3
Atari Games	Atari-57	R2D2	Human World Record Breakthrough	15	# 6
Atari Games	Atari-57	R2D2	Mean Human Normalized Score	3374.31%	# 6
Atari Games	atari game	R2D2	Human World Record Breakthrough	15	# 6
Atari Games	Atari games	R2D2	Mean Human Normalized Score	3374.31%	# 6

Badge	Markdown
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-pong)](https://paperswithcode.com/sota/atari-games-on-atari-2600-pong?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-video-pinball)](https://paperswithcode.com/sota/atari-games-on-atari-2600-video-pinball?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-amidar)](https://paperswithcode.com/sota/atari-games-on-atari-2600-amidar?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-assault)](https://paperswithcode.com/sota/atari-games-on-atari-2600-assault?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-asterix)](https://paperswithcode.com/sota/atari-games-on-atari-2600-asterix?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-bank-heist)](https://paperswithcode.com/sota/atari-games-on-atari-2600-bank-heist?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-gravitar)](https://paperswithcode.com/sota/atari-games-on-atari-2600-gravitar?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-ice-hockey)](https://paperswithcode.com/sota/atari-games-on-atari-2600-ice-hockey?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-star-gunner)](https://paperswithcode.com/sota/atari-games-on-atari-2600-star-gunner?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-yars-revenge)](https://paperswithcode.com/sota/atari-games-on-atari-2600-yars-revenge?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-crazy-climber)](https://paperswithcode.com/sota/atari-games-on-atari-2600-crazy-climber?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-fishing-derby)](https://paperswithcode.com/sota/atari-games-on-atari-2600-fishing-derby?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-hero)](https://paperswithcode.com/sota/atari-games-on-atari-2600-hero?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-kung-fu-master)](https://paperswithcode.com/sota/atari-games-on-atari-2600-kung-fu-master?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-name-this-game)](https://paperswithcode.com/sota/atari-games-on-atari-2600-name-this-game?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-qbert)](https://paperswithcode.com/sota/atari-games-on-atari-2600-qbert?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-skiing)](https://paperswithcode.com/sota/atari-games-on-atari-2600-skiing?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-surround)](https://paperswithcode.com/sota/atari-games-on-atari-2600-surround?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-time-pilot)](https://paperswithcode.com/sota/atari-games-on-atari-2600-time-pilot?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-wizard-of-wor)](https://paperswithcode.com/sota/atari-games-on-atari-2600-wizard-of-wor?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-zaxxon)](https://paperswithcode.com/sota/atari-games-on-atari-2600-zaxxon?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-alien)](https://paperswithcode.com/sota/atari-games-on-atari-2600-alien?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-battle-zone)](https://paperswithcode.com/sota/atari-games-on-atari-2600-battle-zone?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-bowling)](https://paperswithcode.com/sota/atari-games-on-atari-2600-bowling?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-frostbite)](https://paperswithcode.com/sota/atari-games-on-atari-2600-frostbite?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-gopher)](https://paperswithcode.com/sota/atari-games-on-atari-2600-gopher?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-krull)](https://paperswithcode.com/sota/atari-games-on-atari-2600-krull?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-ms-pacman)](https://paperswithcode.com/sota/atari-games-on-atari-2600-ms-pacman?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-pitfall)](https://paperswithcode.com/sota/atari-games-on-atari-2600-pitfall?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-seaquest)](https://paperswithcode.com/sota/atari-games-on-atari-2600-seaquest?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-asteroids)](https://paperswithcode.com/sota/atari-games-on-atari-2600-asteroids?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-beam-rider)](https://paperswithcode.com/sota/atari-games-on-atari-2600-beam-rider?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-berzerk)](https://paperswithcode.com/sota/atari-games-on-atari-2600-berzerk?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-centipede)](https://paperswithcode.com/sota/atari-games-on-atari-2600-centipede?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-river-raid)](https://paperswithcode.com/sota/atari-games-on-atari-2600-river-raid?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-road-runner)](https://paperswithcode.com/sota/atari-games-on-atari-2600-road-runner?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-atlantis)](https://paperswithcode.com/sota/atari-games-on-atari-2600-atlantis?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-chopper-command)](https://paperswithcode.com/sota/atari-games-on-atari-2600-chopper-command?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-enduro)](https://paperswithcode.com/sota/atari-games-on-atari-2600-enduro?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-phoenix)](https://paperswithcode.com/sota/atari-games-on-atari-2600-phoenix?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-tutankham)](https://paperswithcode.com/sota/atari-games-on-atari-2600-tutankham?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-57)](https://paperswithcode.com/sota/atari-games-on-atari-57?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-game)](https://paperswithcode.com/sota/atari-games-on-atari-game?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-games)](https://paperswithcode.com/sota/atari-games-on-atari-games?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-defender)](https://paperswithcode.com/sota/atari-games-on-atari-2600-defender?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-robotank)](https://paperswithcode.com/sota/atari-games-on-atari-2600-robotank?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-breakout)](https://paperswithcode.com/sota/atari-games-on-atari-2600-breakout?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-demon-attack)](https://paperswithcode.com/sota/atari-games-on-atari-2600-demon-attack?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-double-dunk)](https://paperswithcode.com/sota/atari-games-on-atari-2600-double-dunk?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-up-and-down)](https://paperswithcode.com/sota/atari-games-on-atari-2600-up-and-down?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-venture)](https://paperswithcode.com/sota/atari-games-on-atari-2600-venture?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-james-bond)](https://paperswithcode.com/sota/atari-games-on-atari-2600-james-bond?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-space-invaders)](https://paperswithcode.com/sota/atari-games-on-atari-2600-space-invaders?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-kangaroo)](https://paperswithcode.com/sota/atari-games-on-atari-2600-kangaroo?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-private-eye)](https://paperswithcode.com/sota/atari-games-on-atari-2600-private-eye?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-solaris)](https://paperswithcode.com/sota/atari-games-on-atari-2600-solaris?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-montezumas-revenge)](https://paperswithcode.com/sota/atari-games-on-atari-2600-montezumas-revenge?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-boxing)](https://paperswithcode.com/sota/atari-games-on-atari-2600-boxing?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-freeway)](https://paperswithcode.com/sota/atari-games-on-atari-2600-freeway?p=recurrent-experience-replay-in-distributed)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/recurrent-experience-replay-in-distributed/atari-games-on-atari-2600-tennis)](https://paperswithcode.com/sota/atari-games-on-atari-2600-tennis?p=recurrent-experience-replay-in-distributed)`

Recurrent Experience Replay in Distributed Reinforcement Learning

ICLR 2019 · Steven Kapturowski, Georg Ostrovski, Will Dabney, John Quan, Remi Munos ·

Building on the recent successes of distributed training of RL agents, in this paper we investigate the training of RNN-based RL agents from distributed prioritized experience replay. We study the effects of parameter lag resulting in representational drift and recurrent state staleness and empirically derive an improved training strategy. Using a single network architecture and fixed set of hyperparameters, the resulting agent, Recurrent Replay Distributed DQN, quadruples the previous state of the art on Atari-57, and surpasses the state of the art on DMLab-30. It is the first agent to exceed human-level performance in 52 of the 57 Atari games.

PDF Abstract

Code

Add Remove Mark official

ray-project/ray

30,913

opendilab/DI-engine

2,494

michaelnny/deep_rl_zoo

Tasks

Add Remove

Atari Games

reinforcement-learning

Reinforcement Learning (RL)

Datasets

Arcade Learning Environment

DQN Replay Dataset

Results from the Paper

Add Remove

Ranked #1 on Atari Games on Atari 2600 Pong

Get a GitHub badge

Task	Dataset	Model	Metric Name	Metric Value	Global Rank	Benchmark
Atari Games	Atari 2600 Alien	R2D2	Score	229496.9	# 4	Compare
Atari Games	Atari 2600 Amidar	R2D2	Score	29321.4	# 2	Compare
Atari Games	Atari 2600 Assault	R2D2	Score	108197.0	# 2	Compare
Atari Games	Atari 2600 Asterix	R2D2	Score	999153.3	# 2	Compare
Atari Games	Atari 2600 Asteroids	R2D2	Score	357867.7	# 5	Compare
Atari Games	Atari 2600 Atlantis	R2D2	Score	1620764.0	# 6	Compare
Atari Games	Atari 2600 Bank Heist	R2D2	Score	24235.9	# 2	Compare
Atari Games	Atari 2600 Battle Zone	R2D2	Score	751880.0	# 4	Compare
Atari Games	Atari 2600 Beam Rider	R2D2	Score	188257.4	# 5	Compare
Atari Games	Atari 2600 Berzerk	R2D2	Score	53318.7	# 5	Compare
Atari Games	Atari 2600 Bowling	R2D2	Score	219.5	# 4	Compare
Atari Games	Atari 2600 Boxing	R2D2	Score	98.5	# 20	Compare
Atari Games	Atari 2600 Breakout	R2D2	Score	837.7	# 8	Compare
Atari Games	Atari 2600 Centipede	R2D2	Score	599140.3	# 5	Compare
Atari Games	Atari 2600 Chopper Command	R2D2	Score	986652.0	# 6	Compare
Atari Games	Atari 2600 Crazy Climber	R2D2	Score	366690.7	# 3	Compare
Atari Games	Atari 2600 Defender	R2D2	Score	665792.0	# 7	Compare
Atari Games	Atari 2600 Demon Attack	R2D2	Score	140002.3	# 8	Compare
Atari Games	Atari 2600 Double Dunk	R2D2	Score	23.7	# 8	Compare
Atari Games	Atari 2600 Enduro	R2D2	Score	2372.7	# 6	Compare
Atari Games	Atari 2600 Fishing Derby	R2D2	Score	85.8	# 3	Compare
Atari Games	Atari 2600 Freeway	R2D2	Score	32.5	# 25	Compare
Atari Games	Atari 2600 Frostbite	R2D2	Score	315456.4	# 4	Compare
Atari Games	Atari 2600 Gopher	R2D2	Score	124776.3	# 4	Compare
Atari Games	Atari 2600 Gravitar	R2D2	Score	15680.7	# 2	Compare
Atari Games	Atari 2600 HERO	R2D2	Score	39537.1	# 3	Compare
Atari Games	Atari 2600 Ice Hockey	R2D2	Score	79.3	# 2	Compare
Atari Games	Atari 2600 James Bond	R2D2	Score	25354.0	# 10	Compare
Atari Games	Atari 2600 Kangaroo	R2D2	Score	14130.7	# 13	Compare
Atari Games	Atari 2600 Krull	R2D2	Score	218448.1	# 4	Compare
Atari Games	Atari 2600 Kung-Fu Master	R2D2	Score	233413.3	# 3	Compare
Atari Games	Atari 2600 Montezuma's Revenge	R2D2	Score	2061.3	# 18	Compare
Atari Games	Atari 2600 Ms. Pacman	R2D2	Score	42281.7	# 4	Compare
Atari Games	Atari 2600 Name This Game	R2D2	Score	58182.7	# 3	Compare
Atari Games	Atari 2600 Phoenix	R2D2	Score	864020.0	# 6	Compare
Atari Games	Atari 2600 Pitfall!	R2D2	Score	0.0	# 4	Compare
Atari Games	Atari 2600 Pong	R2D2	Score	21.0	# 1	Compare
Atari Games	Atari 2600 Private Eye	R2D2	Score	5322.7	# 13	Compare
Atari Games	Atari 2600 Q*Bert	R2D2	Score	408850.0	# 3	Compare
Atari Games	Atari 2600 River Raid	R2D2	Score	45632.1	# 5	Compare
Atari Games	Atari 2600 Road Runner	R2D2	Score	599246.7	# 5	Compare
Atari Games	Atari 2600 Robotank	R2D2	Score	100.4	# 7	Compare
Atari Games	Atari 2600 Seaquest	R2D2	Score	999996.7	# 4	Compare
Atari Games	Atari 2600 Skiing	R2D2	Score	-30021.7	# 3	Compare
Atari Games	Atari 2600 Solaris	R2D2	Score	3787.2	# 15	Compare
Atari Games	Atari 2600 Space Invaders	R2D2	Score	43223.4	# 10	Compare
Atari Games	Atari 2600 Star Gunner	R2D2	Score	717344.0	# 2	Compare
Atari Games	Atari 2600 Surround	R2D2	Score	9.9	# 3	Compare
Atari Games	Atari 2600 Tennis	R2D2	Score	-0.1	# 29	Compare
Atari Games	Atari 2600 Time Pilot	R2D2	Score	445377.3	# 3	Compare
Atari Games	Atari 2600 Tutankham	R2D2	Score	395.3	# 6	Compare
Atari Games	Atari 2600 Up and Down	R2D2	Score	589226.9	# 8	Compare
Atari Games	Atari 2600 Venture	R2D2	Score	1970.7	# 8	Compare
Atari Games	Atari 2600 Video Pinball	R2D2	Score	999383.2	# 1	Compare
Atari Games	Atari 2600 Wizard of Wor	R2D2	Score	144362.7	# 3	Compare
Atari Games	Atari 2600 Yars Revenge	R2D2	Score	995048.4	# 2	Compare
Atari Games	Atari 2600 Zaxxon	R2D2	Score	224910.7	# 3	Compare
Atari Games	Atari-57	R2D2	Human World Record Breakthrough	15	# 6	Compare
Atari Games	Atari-57	R2D2	Mean Human Normalized Score	3374.31%	# 6	Compare
Atari Games	atari game	R2D2	Human World Record Breakthrough	15	# 6	Compare
Atari Games	Atari games	R2D2	Mean Human Normalized Score	3374.31%	# 6	Compare

Methods

Add Remove

Convolution • Dense Connections • DQN • Q-Learning • R2D2

Edit Social Preview

Recurrent Experience Replay in Distributed Reinforcement Learning

Code Edit Add Remove Mark official

Tasks Edit Add Remove

Datasets Edit

Results from the Paper Edit Add Remove

Methods Edit Add Remove

Code

Add Remove Mark official

Tasks

Add Remove

Datasets

Results from the Paper

Add Remove

Methods

Add Remove