Evolving simple programs for playing Atari games

14 Jun 2018  ยท  Dennis G Wilson, Sylvain Cussat-Blanc, Hervรฉ Luga, Julian F. Miller ยท

Cartesian Genetic Programming (CGP) has previously shown capabilities in image processing tasks by evolving programs with a function set specialized for computer vision. A similar approach can be applied to Atari playing. Programs are evolved using mixed type CGP with a function set suited for matrix operations, including image processing, but allowing for controller behavior to emerge. While the programs are relatively small, many controllers are competitive with state of the art methods for the Atari benchmark set and require less training time. By evaluating the programs of the best evolved individuals, simple but effective strategies can be found.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Atari Games Atari 2600 Alien CGP Score 1978 # 30
Atari Games Atari 2600 Amidar CGP Score 199 # 37
Atari Games Atari 2600 Assault CGP Score 890.4 # 41
Atari Games Atari 2600 Asterix CGP Score 1880 # 44
Atari Games Atari 2600 Asteroids CGP Score 9412 # 12
Atari Games Atari 2600 Atlantis CGP Score 99240 # 39
Atari Games Atari 2600 Bank Heist CGP Score 148 # 43
Atari Games Atari 2600 Battle Zone CGP Score 34200 # 21
Atari Games Atari 2600 Beam Rider CGP Score 1341.6 # 45
Atari Games Atari 2600 Berzerk CGP Score 1138 # 26
Atari Games Atari 2600 Bowling CGP Score 85.8 # 14
Atari Games Atari 2600 Boxing CGP Score 38.4 # 41
Atari Games Atari 2600 Breakout CGP Score 13.2 # 53
Atari Games Atari 2600 Centipede CGP Score 24708 # 13
Atari Games Atari 2600 Chopper Command CGP Score 3580 # 38
Atari Games Atari 2600 Crazy Climber CGP Score 12900 # 47
Atari Games Atari 2600 Defender CGP Score 993010 # 1
Atari Games Atari 2600 Demon Attack CGP Score 2387 # 41
Atari Games Atari 2600 Double Dunk CGP Score 2 # 19
Atari Games Atari 2600 Enduro CGP Score 56.8 # 43
Atari Games Atari 2600 Fishing Derby CGP Score -51 # 36
Atari Games Atari 2600 Freeway CGP Score 28.2 # 39
Atari Games Atari 2600 Frostbite CGP Score 782 # 37
Atari Games Atari 2600 Gopher CGP Score 1696 # 40
Atari Games Atari 2600 Gravitar CGP Score 2350 # 15
Atari Games Atari 2600 HERO CGP Score 2974 # 44
Atari Games Atari 2600 Ice Hockey CGP Score 4 # 13
Atari Games Atari 2600 James Bond CGP Score 6130 # 13
Atari Games Atari 2600 Kangaroo CGP Score 1400 # 39
Atari Games Atari 2600 Krull CGP Score 9086.8 # 23
Atari Games Atari 2600 Kung-Fu Master CGP Score 57400 # 15
Atari Games Atari 2600 Montezuma's Revenge CGP Score 0 # 42
Atari Games Atari 2600 Ms. Pacman CGP Score 2568 # 31
Atari Games Atari 2600 Name This Game CGP Score 3696 # 40
Atari Games Atari 2600 Phoenix CGP Score 7520 # 20
Atari Games Atari 2600 Pitfall! CGP Score 0 # 4
Atari Games Atari 2600 Pong CGP Score 20 # 28
Atari Games Atari 2600 Private Eye CGP Score 12702.2 # 10
Atari Games Atari 2600 Q*Bert CGP Score 770 # 51
Atari Games Atari 2600 River Raid CGP Score 2914 # 39
Atari Games Atari 2600 Road Runner CGP Score 8960 # 40
Atari Games Atari 2600 Robotank CGP Score 24.2 # 35
Atari Games Atari 2600 Seaquest CGP Score 724 # 48
Atari Games Atari 2600 Skiing CGP Score -9011 # 3
Atari Games Atari 2600 Solaris CGP Score 8324 # 9
Atari Games Atari 2600 Space Invaders CGP Score 1001 # 45
Atari Games Atari 2600 Star Gunner CGP Score 2320 # 38
Atari Games Atari 2600 Tennis CGP Score 0 # 20
Atari Games Atari 2600 Time Pilot CGP Score 12040 # 20
Atari Games Atari 2600 Tutankham CGP Score 0 # 44
Atari Games Atari 2600 Up and Down CGP Score 14524 # 34
Atari Games Atari 2600 Venture CGP Score 0 # 49
Atari Games Atari 2600 Video Pinball CGP Score 33752.4 # 39
Atari Games Atari 2600 Wizard of Wor CGP Score 3820 # 34
Atari Games Atari 2600 Yars Revenge CGP Score 28838.2 # 14
Atari Games Atari 2600 Zaxxon CGP Score 2980 # 39

Methods


No methods listed for this paper. Add relevant methods here