The Arcade Learning Environment: An Evaluation Platform for General Agents

19 Jul 2012  ยท  Marc G. Bellemare, Yavar Naddaf, Joel Veness, Michael Bowling ยท

In this article we introduce the Arcade Learning Environment (ALE): both a challenge problem and a platform and methodology for evaluating the development of general, domain-independent AI technology. ALE provides an interface to hundreds of Atari 2600 game environments, each one different, interesting, and designed to be a challenge for human players. ALE presents significant research challenges for reinforcement learning, model learning, model-based planning, imitation learning, transfer learning, and intrinsic motivation. Most importantly, it provides a rigorous testbed for evaluating and comparing approaches to these problems. We illustrate the promise of ALE by developing and benchmarking domain-independent agents designed using well-established AI techniques for both reinforcement learning and planning. In doing so, we also propose an evaluation methodology made possible by ALE, reporting empirical results on over 55 different games. All of the software, including the benchmark agents, is publicly available.

PDF Abstract

Datasets


Introduced in the Paper:

Arcade Learning Environment

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Atari Games Atari 2600 Alien Best Learner Score 939.2 # 41
Atari Games Atari 2600 Alien UCT Score 7785 # 12
Atari Games Atari 2600 Amidar UCT Score 180.3 # 40
Atari Games Atari 2600 Amidar Best Learner Score 103.4 # 47
Atari Games Atari 2600 Assault UCT Score 1512.2 # 39
Atari Games Atari 2600 Assault Best Learner Score 628 # 42
Atari Games Atari 2600 Asterix Best Learner Score 987.3 # 47
Atari Games Atari 2600 Asterix UCT Score 290700 # 17
Atari Games Atari 2600 Asteroids Best Learner Score 907.3 # 41
Atari Games Atari 2600 Asteroids UCT Score 4660.6 # 14
Atari Games Atari 2600 Atlantis UCT Score 193858 # 37
Atari Games Atari 2600 Atlantis Best Learner Score 62687 # 41
Atari Games Atari 2600 Bank Heist Best Learner Score 190.8 # 42
Atari Games Atari 2600 Bank Heist UCT Score 497.8 # 34
Atari Games Atari 2600 Battle Zone UCT Score 70333.3 # 10
Atari Games Atari 2600 Battle Zone Best Learner Score 15819.7 # 40
Atari Games Atari 2600 Beam Rider UCT Score 6624.6 # 37
Atari Games Atari 2600 Beam Rider Best Learner Score 929.4 # 46
Atari Games Atari 2600 Berzerk Best Learner Score 501.3 # 38
Atari Games Atari 2600 Berzerk Best Baseline Score 670 # 36
Atari Games Atari 2600 Bowling Best Learner Score 43.9 # 35
Atari Games Atari 2600 Boxing UCT Score 100 # 1
Atari Games Atari 2600 Boxing Best Learner Score 44 # 40
Atari Games Atari 2600 Breakout UCT Score 364.4 # 34
Atari Games Atari 2600 Breakout Best Learner Score 5.2 # 58
Atari Games Atari 2600 Carnival UCT Score 5132.0 # 1
Atari Games Atari 2600 Centipede Best Learner Score 8803.8 # 20
Atari Games Atari 2600 Centipede Full Tree Score 125123 # 10
Atari Games Atari 2600 Chopper Command Best Learner Score 1581.5 # 42
Atari Games Atari 2600 Chopper Command UCT Score 34018.8 # 10
Atari Games Atari 2600 Crazy Climber Best Learner Score 23410.6 # 46
Atari Games Atari 2600 Crazy Climber UCT Score 98172.2 # 38
Atari Games Atari 2600 Demon Attack UCT Score 28158.8 # 34
Atari Games Atari 2600 Demon Attack Best Learner Score 520.5 # 44
Atari Games Atari 2600 Double Dunk UCT Score 24 # 1
Atari Games Atari 2600 Double Dunk Best Learner Score -13.1 # 26
Atari Games Atari 2600 Elevator Action UCT Score 18100.0 # 3
Atari Games Atari 2600 Enduro UCT Score 286.3 # 38
Atari Games Atari 2600 Enduro Best Learner Score 129.1 # 40
Atari Games Atari 2600 Fishing Derby UCT Score 37.8 # 20
Atari Games Atari 2600 Fishing Derby Best Learner Score -89.5 # 36
Atari Games Atari 2600 Freeway Best Learner Score 19.1 # 49
Atari Games Atari 2600 Freeway Best Baseline Score 22.5 # 44
Atari Games Atari 2600 Freeway UCT Score 0.4 # 52
Atari Games Atari 2600 Frostbite Best Learner Score 216.9 # 48
Atari Games Atari 2600 Frostbite UCT Score 270.5 # 47
Atari Games Atari 2600 Gopher Best Learner Score 1288.3 # 41
Atari Games Atari 2600 Gopher UCT Score 20560 # 22
Atari Games Atari 2600 Gravitar UCT Score 2850 # 13
Atari Games Atari 2600 Gravitar Best Learner Score 387.7 # 39
Atari Games Atari 2600 HERO UCT Score 12859.5 # 37
Atari Games Atari 2600 HERO Best Learner Score 6458.8 # 42
Atari Games Atari 2600 HERO Best linear Score 6459 # 41
Atari Games Atari 2600 Ice Hockey UCT Score 39.4 # 8
Atari Games Atari 2600 Ice Hockey Best Learner Score -9.5 # 20
Atari Games Atari 2600 James Bond UCT Score 330 # 41
Atari Games Atari 2600 James Bond Best Learner Score 202.8 # 43
Atari Games Atari 2600 Journey Escape UCT Score 7683.3 # 1
Atari Games Atari 2600 Kangaroo Best Learner Score 1622.1 # 36
Atari Games Atari 2600 Kangaroo UCT Score 1990 # 33
Atari Games Atari 2600 Krull UCT Score 5037 # 40
Atari Games Atari 2600 Krull Best Learner Score 3371.5 # 43
Atari Games Atari 2600 Kung-Fu Master Best Learner Score 19544 # 41
Atari Games Atari 2600 Kung-Fu Master UCT Score 48854.5 # 16
Atari Games Atari 2600 Montezuma's Revenge Best Learner Score 10.7 # 39
Atari Games Atari 2600 Ms. Pacman UCT Score 22336 # 5
Atari Games Atari 2600 Ms. Pacman Best Learner Score 1691.8 # 35
Atari Games Atari 2600 Name This Game UCT Score 15410 # 16
Atari Games Atari 2600 Name This Game Best Learner Score 2500.1 # 41
Atari Games Atari 2600 Pong UCT Score 21 # 1
Atari Games Atari 2600 Pong Best Learner Score -19 # 50
Atari Games Atari 2600 Pooyan UCT Score 17763.4 # 1
Atari Games Atari 2600 Pooyan Best Learner Score 1225.3 # 3
Atari Games Atari 2600 Private Eye Best Baseline Score 1947.3 # 19
Atari Games Atari 2600 Private Eye Best Learner Score 684.3 # 23
Atari Games Atari 2600 Q*Bert UCT Score 17343.4 # 22
Atari Games Atari 2600 Q*Bert Best Learner Score 613.5 # 52
Atari Games Atari 2600 River Raid Best Learner Score 1904.3 # 41
Atari Games Atari 2600 River Raid UCT Score 4449 # 37
Atari Games Atari 2600 Road Runner UCT Score 38725 # 33
Atari Games Atari 2600 Road Runner Best Learner Score 67.7 # 44
Atari Games Atari 2600 Robotank UCT Score 50.4 # 30
Atari Games Atari 2600 Robotank Best Learner Score 28.7 # 32
Atari Games Atari 2600 Seaquest UCT Score 5132.4 # 33
Atari Games Atari 2600 Seaquest Best Learner Score 664.8 # 50
Atari Games Atari 2600 Skiing Full Tree Score 0 # 1
Atari Games Atari 2600 Skiing Best Learner Score 0 # 1
Atari Games Atari 2600 Space Invaders Best Learner Score 250.1 # 52
Atari Games Atari 2600 Space Invaders UCT Score 2718 # 30
Atari Games Atari 2600 Star Gunner Full Tree Score 1345 # 40
Atari Games Atari 2600 Star Gunner Best Learner Score 1069.5 # 41
Atari Games Atari 2600 Tennis Best Learner Score -0.1 # 29
Atari Games Atari 2600 Tennis UCT Score 2.8 # 18
Atari Games Atari 2600 Time Pilot UCT Score 63854.5 # 9
Atari Games Atari 2600 Time Pilot Best Learner Score 3741.2 # 43
Atari Games Atari 2600 Tutankham UCT Score 225.5 # 20
Atari Games Atari 2600 Tutankham Best Learner Score 114.3 # 35
Atari Games Atari 2600 Up and Down Best Learner Score 3532.7 # 41
Atari Games Atari 2600 Up and Down UCT Score 74473.6 # 17
Atari Games Atari 2600 Venture Best Learner Score 66 # 35
Atari Games Atari 2600 Video Pinball UCT Score 254748 # 26
Atari Games Atari 2600 Video Pinball Best Learner Score 16871.3 # 42
Atari Games Atari 2600 Wizard of Wor UCT Score 105500 # 4
Atari Games Atari 2600 Wizard of Wor Best Learner Score 1981.3 # 38
Atari Games Atari 2600 Zaxxon UCT Score 22610 # 12
Atari Games Atari 2600 Zaxxon Best Learner Score 3365.1 # 38

Methods


No methods listed for this paper. Add relevant methods here