TASK	DATASET	MODEL	METRIC NAME	METRIC VALUE	GLOBAL RANK
Atari Games	Atari 2600 Alien	DDQN+Pop-Art noop	Score	3213.5	# 25
Atari Games	Atari 2600 Amidar	DDQN+Pop-Art noop	Score	782.5	# 27
Atari Games	Atari 2600 Assault	DDQN+Pop-Art noop	Score	9011.6	# 19
Atari Games	Atari 2600 Asterix	DDQN+Pop-Art noop	Score	18919.5	# 29
Atari Games	Atari 2600 Asteroids	DDQN+Pop-Art noop	Score	2869.3	# 21
Atari Games	Atari 2600 Atlantis	DDQN+Pop-Art noop	Score	340076.0	# 31
Atari Games	Atari 2600 Bank Heist	DDQN+Pop-Art noop	Score	1103.3	# 22
Atari Games	Atari 2600 Battle Zone	DDQN+Pop-Art noop	Score	8220.0	# 45
Atari Games	Atari 2600 Beam Rider	DDQN+Pop-Art noop	Score	8299.4	# 35
Atari Games	Atari 2600 Berzerk	DDQN+Pop-Art noop	Score	1199.6	# 25
Atari Games	Atari 2600 Bowling	DDQN+Pop-Art noop	Score	102.1	# 12
Atari Games	Atari 2600 Boxing	DDQN+Pop-Art noop	Score	99.3	# 18
Atari Games	Atari 2600 Breakout	DDQN+Pop-Art noop	Score	344.1	# 39
Atari Games	Atari 2600 Centipede	DDQN+Pop-Art noop	Score	49065.8	# 12
Atari Games	Atari 2600 Chopper Command	DDQN+Pop-Art noop	Score	775.0	# 44
Atari Games	Atari 2600 Crazy Climber	DDQN+Pop-Art noop	Score	119679.0	# 31
Atari Games	Atari 2600 Demon Attack	DDQN+Pop-Art noop	Score	63644.9	# 28
Atari Games	Atari 2600 Double Dunk	DDQN+Pop-Art noop	Score	-11.5	# 26
Atari Games	Atari 2600 Enduro	DDQN+Pop-Art noop	Score	2002.1	# 21
Atari Games	Atari 2600 Fishing Derby	DDQN+Pop-Art noop	Score	45.1	# 14
Atari Games	Atari 2600 Freeway	DDQN+Pop-Art noop	Score	33.4	# 16
Atari Games	Atari 2600 Frostbite	DDQN+Pop-Art noop	Score	3469.6	# 24
Atari Games	Atari 2600 Gopher	DDQN+Pop-Art noop	Score	56218.2	# 16
Atari Games	Atari 2600 Gravitar	DDQN+Pop-Art noop	Score	483.5	# 32
Atari Games	Atari 2600 HERO	DDQN+Pop-Art noop	Score	14225.2	# 36
Atari Games	Atari 2600 Ice Hockey	DDQN+Pop-Art noop	Score	-4.1	# 20
Atari Games	Atari 2600 James Bond	DDQN+Pop-Art noop	Score	507.5	# 36
Atari Games	Atari 2600 Kangaroo	DDQN+Pop-Art noop	Score	13150.0	# 16
Atari Games	Atari 2600 Krull	DDQN+Pop-Art noop	Score	9745.1	# 19
Atari Games	Atari 2600 Kung-Fu Master	DDQN+Pop-Art noop	Score	34393.0	# 27
Atari Games	Atari 2600 Ms. Pacman	DDQN+Pop-Art noop	Score	4963.8	# 20
Atari Games	Atari 2600 Name This Game	DDQN+Pop-Art noop	Score	15851.2	# 14
Atari Games	Atari 2600 Pong	DDQN+Pop-Art noop	Score	20.6	# 24
Atari Games	Atari 2600 Private Eye	DDQN+Pop-Art noop	Score	286.7	# 30
Atari Games	Atari 2600 Q*Bert	DDQN+Pop-Art noop	Score	5236.8	# 43
Atari Games	Atari 2600 River Raid	DDQN+Pop-Art noop	Score	12530.8	# 24
Atari Games	Atari 2600 Road Runner	DDQN+Pop-Art noop	Score	47770.0	# 27
Atari Games	Atari 2600 Robotank	DDQN+Pop-Art noop	Score	64.3	# 17
Atari Games	Atari 2600 Seaquest	DDQN+Pop-Art noop	Score	10932.3	# 21
Atari Games	Atari 2600 Space Invaders	DDQN+Pop-Art noop	Score	2589.7	# 32
Atari Games	Atari 2600 Star Gunner	DDQN+Pop-Art noop	Score	589.0	# 42
Atari Games	Atari 2600 Tennis	DDQN+Pop-Art noop	Score	12.1	# 14
Atari Games	Atari 2600 Time Pilot	DDQN+Pop-Art noop	Score	4870.0	# 38
Atari Games	Atari 2600 Tutankham	DDQN+Pop-Art noop	Score	183.9	# 28
Atari Games	Atari 2600 Up and Down	DDQN+Pop-Art noop	Score	22474.4	# 30
Atari Games	Atari 2600 Venture	DDQN+Pop-Art noop	Score	1172.0	# 17
Atari Games	Atari 2600 Video Pinball	DDQN+Pop-Art noop	Score	56287.0	# 35
Atari Games	Atari 2600 Wizard of Wor	DDQN+Pop-Art noop	Score	483.0	# 40
Atari Games	Atari 2600 Zaxxon	DDQN+Pop-Art noop	Score	14402.0	# 18

Badge	Markdown
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-bowling)](https://paperswithcode.com/sota/atari-games-on-atari-2600-bowling?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-centipede)](https://paperswithcode.com/sota/atari-games-on-atari-2600-centipede?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-fishing-derby)](https://paperswithcode.com/sota/atari-games-on-atari-2600-fishing-derby?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-name-this-game)](https://paperswithcode.com/sota/atari-games-on-atari-2600-name-this-game?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-tennis)](https://paperswithcode.com/sota/atari-games-on-atari-2600-tennis?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-freeway)](https://paperswithcode.com/sota/atari-games-on-atari-2600-freeway?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-gopher)](https://paperswithcode.com/sota/atari-games-on-atari-2600-gopher?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-kangaroo)](https://paperswithcode.com/sota/atari-games-on-atari-2600-kangaroo?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-robotank)](https://paperswithcode.com/sota/atari-games-on-atari-2600-robotank?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-venture)](https://paperswithcode.com/sota/atari-games-on-atari-2600-venture?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-boxing)](https://paperswithcode.com/sota/atari-games-on-atari-2600-boxing?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-zaxxon)](https://paperswithcode.com/sota/atari-games-on-atari-2600-zaxxon?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-assault)](https://paperswithcode.com/sota/atari-games-on-atari-2600-assault?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-krull)](https://paperswithcode.com/sota/atari-games-on-atari-2600-krull?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-ice-hockey)](https://paperswithcode.com/sota/atari-games-on-atari-2600-ice-hockey?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-ms-pacman)](https://paperswithcode.com/sota/atari-games-on-atari-2600-ms-pacman?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-asteroids)](https://paperswithcode.com/sota/atari-games-on-atari-2600-asteroids?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-enduro)](https://paperswithcode.com/sota/atari-games-on-atari-2600-enduro?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-seaquest)](https://paperswithcode.com/sota/atari-games-on-atari-2600-seaquest?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-bank-heist)](https://paperswithcode.com/sota/atari-games-on-atari-2600-bank-heist?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-frostbite)](https://paperswithcode.com/sota/atari-games-on-atari-2600-frostbite?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-pong)](https://paperswithcode.com/sota/atari-games-on-atari-2600-pong?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-river-raid)](https://paperswithcode.com/sota/atari-games-on-atari-2600-river-raid?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-alien)](https://paperswithcode.com/sota/atari-games-on-atari-2600-alien?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-berzerk)](https://paperswithcode.com/sota/atari-games-on-atari-2600-berzerk?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-double-dunk)](https://paperswithcode.com/sota/atari-games-on-atari-2600-double-dunk?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-amidar)](https://paperswithcode.com/sota/atari-games-on-atari-2600-amidar?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-kung-fu-master)](https://paperswithcode.com/sota/atari-games-on-atari-2600-kung-fu-master?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-road-runner)](https://paperswithcode.com/sota/atari-games-on-atari-2600-road-runner?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-demon-attack)](https://paperswithcode.com/sota/atari-games-on-atari-2600-demon-attack?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-tutankham)](https://paperswithcode.com/sota/atari-games-on-atari-2600-tutankham?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-asterix)](https://paperswithcode.com/sota/atari-games-on-atari-2600-asterix?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-private-eye)](https://paperswithcode.com/sota/atari-games-on-atari-2600-private-eye?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-up-and-down)](https://paperswithcode.com/sota/atari-games-on-atari-2600-up-and-down?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-atlantis)](https://paperswithcode.com/sota/atari-games-on-atari-2600-atlantis?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-crazy-climber)](https://paperswithcode.com/sota/atari-games-on-atari-2600-crazy-climber?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-gravitar)](https://paperswithcode.com/sota/atari-games-on-atari-2600-gravitar?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-space-invaders)](https://paperswithcode.com/sota/atari-games-on-atari-2600-space-invaders?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-beam-rider)](https://paperswithcode.com/sota/atari-games-on-atari-2600-beam-rider?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-video-pinball)](https://paperswithcode.com/sota/atari-games-on-atari-2600-video-pinball?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-hero)](https://paperswithcode.com/sota/atari-games-on-atari-2600-hero?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-james-bond)](https://paperswithcode.com/sota/atari-games-on-atari-2600-james-bond?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-time-pilot)](https://paperswithcode.com/sota/atari-games-on-atari-2600-time-pilot?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-breakout)](https://paperswithcode.com/sota/atari-games-on-atari-2600-breakout?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-wizard-of-wor)](https://paperswithcode.com/sota/atari-games-on-atari-2600-wizard-of-wor?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-star-gunner)](https://paperswithcode.com/sota/atari-games-on-atari-2600-star-gunner?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-qbert)](https://paperswithcode.com/sota/atari-games-on-atari-2600-qbert?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-chopper-command)](https://paperswithcode.com/sota/atari-games-on-atari-2600-chopper-command?p=learning-values-across-many-orders-of)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/learning-values-across-many-orders-of/atari-games-on-atari-2600-battle-zone)](https://paperswithcode.com/sota/atari-games-on-atari-2600-battle-zone?p=learning-values-across-many-orders-of)`

Learning values across many orders of magnitude

NeurIPS 2016 · Hado van Hasselt, Arthur Guez, Matteo Hessel, Volodymyr Mnih, David Silver ·

Most learning algorithms are not invariant to the scale of the function that is being approximated. We propose to adaptively normalize the targets used in learning. This is useful in value-based reinforcement learning, where the magnitude of appropriate value approximations can change over time when we update the policy of behavior. Our main motivation is prior work on learning to play Atari games, where the rewards were all clipped to a predetermined range. This clipping facilitates learning across many different games with a single learning algorithm, but a clipped reward function can result in qualitatively different behavior. Using the adaptive normalization we can remove this domain-specific heuristic without diminishing overall performance.

PDF Abstract NeurIPS 2016 PDF NeurIPS 2016 Abstract

Code

Add Remove Mark official

No code implementations yet. Submit your code now

Tasks

Add Remove

Atari Games

reinforcement-learning

Reinforcement Learning (RL)

Datasets

Arcade Learning Environment

Results from the Paper

Edit

Ranked #12 on Atari Games on Atari 2600 Centipede

Get a GitHub badge

Task	Dataset	Model	Metric Name	Metric Value	Global Rank	Benchmark
Atari Games	Atari 2600 Alien	DDQN+Pop-Art noop	Score	3213.5	# 25	Compare
Atari Games	Atari 2600 Amidar	DDQN+Pop-Art noop	Score	782.5	# 27	Compare
Atari Games	Atari 2600 Assault	DDQN+Pop-Art noop	Score	9011.6	# 19	Compare
Atari Games	Atari 2600 Asterix	DDQN+Pop-Art noop	Score	18919.5	# 29	Compare
Atari Games	Atari 2600 Asteroids	DDQN+Pop-Art noop	Score	2869.3	# 21	Compare
Atari Games	Atari 2600 Atlantis	DDQN+Pop-Art noop	Score	340076.0	# 31	Compare
Atari Games	Atari 2600 Bank Heist	DDQN+Pop-Art noop	Score	1103.3	# 22	Compare
Atari Games	Atari 2600 Battle Zone	DDQN+Pop-Art noop	Score	8220.0	# 45	Compare
Atari Games	Atari 2600 Beam Rider	DDQN+Pop-Art noop	Score	8299.4	# 35	Compare
Atari Games	Atari 2600 Berzerk	DDQN+Pop-Art noop	Score	1199.6	# 25	Compare
Atari Games	Atari 2600 Bowling	DDQN+Pop-Art noop	Score	102.1	# 12	Compare
Atari Games	Atari 2600 Boxing	DDQN+Pop-Art noop	Score	99.3	# 18	Compare
Atari Games	Atari 2600 Breakout	DDQN+Pop-Art noop	Score	344.1	# 39	Compare
Atari Games	Atari 2600 Centipede	DDQN+Pop-Art noop	Score	49065.8	# 12	Compare
Atari Games	Atari 2600 Chopper Command	DDQN+Pop-Art noop	Score	775.0	# 44	Compare
Atari Games	Atari 2600 Crazy Climber	DDQN+Pop-Art noop	Score	119679.0	# 31	Compare
Atari Games	Atari 2600 Demon Attack	DDQN+Pop-Art noop	Score	63644.9	# 28	Compare
Atari Games	Atari 2600 Double Dunk	DDQN+Pop-Art noop	Score	-11.5	# 26	Compare
Atari Games	Atari 2600 Enduro	DDQN+Pop-Art noop	Score	2002.1	# 21	Compare
Atari Games	Atari 2600 Fishing Derby	DDQN+Pop-Art noop	Score	45.1	# 14	Compare
Atari Games	Atari 2600 Freeway	DDQN+Pop-Art noop	Score	33.4	# 16	Compare
Atari Games	Atari 2600 Frostbite	DDQN+Pop-Art noop	Score	3469.6	# 24	Compare
Atari Games	Atari 2600 Gopher	DDQN+Pop-Art noop	Score	56218.2	# 16	Compare
Atari Games	Atari 2600 Gravitar	DDQN+Pop-Art noop	Score	483.5	# 32	Compare
Atari Games	Atari 2600 HERO	DDQN+Pop-Art noop	Score	14225.2	# 36	Compare
Atari Games	Atari 2600 Ice Hockey	DDQN+Pop-Art noop	Score	-4.1	# 20	Compare
Atari Games	Atari 2600 James Bond	DDQN+Pop-Art noop	Score	507.5	# 36	Compare
Atari Games	Atari 2600 Kangaroo	DDQN+Pop-Art noop	Score	13150.0	# 16	Compare
Atari Games	Atari 2600 Krull	DDQN+Pop-Art noop	Score	9745.1	# 19	Compare
Atari Games	Atari 2600 Kung-Fu Master	DDQN+Pop-Art noop	Score	34393.0	# 27	Compare
Atari Games	Atari 2600 Ms. Pacman	DDQN+Pop-Art noop	Score	4963.8	# 20	Compare
Atari Games	Atari 2600 Name This Game	DDQN+Pop-Art noop	Score	15851.2	# 14	Compare
Atari Games	Atari 2600 Pong	DDQN+Pop-Art noop	Score	20.6	# 24	Compare
Atari Games	Atari 2600 Private Eye	DDQN+Pop-Art noop	Score	286.7	# 30	Compare
Atari Games	Atari 2600 Q*Bert	DDQN+Pop-Art noop	Score	5236.8	# 43	Compare
Atari Games	Atari 2600 River Raid	DDQN+Pop-Art noop	Score	12530.8	# 24	Compare
Atari Games	Atari 2600 Road Runner	DDQN+Pop-Art noop	Score	47770.0	# 27	Compare
Atari Games	Atari 2600 Robotank	DDQN+Pop-Art noop	Score	64.3	# 17	Compare
Atari Games	Atari 2600 Seaquest	DDQN+Pop-Art noop	Score	10932.3	# 21	Compare
Atari Games	Atari 2600 Space Invaders	DDQN+Pop-Art noop	Score	2589.7	# 32	Compare
Atari Games	Atari 2600 Star Gunner	DDQN+Pop-Art noop	Score	589.0	# 42	Compare
Atari Games	Atari 2600 Tennis	DDQN+Pop-Art noop	Score	12.1	# 14	Compare
Atari Games	Atari 2600 Time Pilot	DDQN+Pop-Art noop	Score	4870.0	# 38	Compare
Atari Games	Atari 2600 Tutankham	DDQN+Pop-Art noop	Score	183.9	# 28	Compare
Atari Games	Atari 2600 Up and Down	DDQN+Pop-Art noop	Score	22474.4	# 30	Compare
Atari Games	Atari 2600 Venture	DDQN+Pop-Art noop	Score	1172.0	# 17	Compare
Atari Games	Atari 2600 Video Pinball	DDQN+Pop-Art noop	Score	56287.0	# 35	Compare
Atari Games	Atari 2600 Wizard of Wor	DDQN+Pop-Art noop	Score	483.0	# 40	Compare
Atari Games	Atari 2600 Zaxxon	DDQN+Pop-Art noop	Score	14402.0	# 18	Compare

Methods

Add Remove

No methods listed for this paper. Add relevant methods here

Edit Social Preview

Learning values across many orders of magnitude

Code Edit Add Remove Mark official

Tasks Edit Add Remove

Datasets Edit

Results from the Paper Edit

Methods Edit Add Remove

Code

Add Remove Mark official

Tasks

Add Remove

Datasets

Results from the Paper

Edit

Methods

Add Remove