TASK	DATASET	MODEL	METRIC NAME	METRIC VALUE	GLOBAL RANK
Atari Games	Atari 2600 Alien	SAC	Score	216.9	# 47
Atari Games	Atari 2600 Amidar	SAC	Score	7.9	# 48
Atari Games	Atari 2600 Assault	SAC	Score	350	# 45
Atari Games	Atari 2600 Asterix	SAC	Score	272	# 49
Atari Games	Atari 2600 Battle Zone	SAC	Score	4386.7	# 46
Atari Games	Atari 2600 Beam Rider	SAC	Score	432.1	# 48
Atari Games	Atari 2600 Breakout	SAC	Score	0.7	# 58
Atari Games	Atari 2600 Crazy Climber	SAC	Score	3668.7	# 48
Atari Games	Atari 2600 Enduro	SAC	Score	0.8	# 44
Atari Games	Atari 2600 Freeway	SAC	Score	4.4	# 51
Atari Games	Atari 2600 Frostbite	SAC	Score	59.4	# 53
Atari Games	Atari 2600 James Bond	SAC	Score	68.3	# 44
Atari Games	Atari 2600 Kangaroo	SAC	Score	29.3	# 46
Atari Games	Atari 2600 Ms. Pacman	SAC	Score	690.9	# 44
Atari Games	Atari 2600 Pong	SAC	Score	-20.98	# 50
Atari Games	Atari 2600 Q*Bert	SAC	Score	280.5	# 53
Atari Games	Atari 2600 Road Runner	SAC	Score	305.3	# 42
Atari Games	Atari 2600 Seaquest	SAC	Score	211.6	# 55
Atari Games	Atari 2600 Space Invaders	SAC	Score	160.8	# 53
Atari Games	Atari 2600 Up and Down	SAC	Score	250.7	# 44

Badge	Markdown
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-road-runner)](https://paperswithcode.com/sota/atari-games-on-atari-2600-road-runner?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-enduro)](https://paperswithcode.com/sota/atari-games-on-atari-2600-enduro?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-james-bond)](https://paperswithcode.com/sota/atari-games-on-atari-2600-james-bond?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-ms-pacman)](https://paperswithcode.com/sota/atari-games-on-atari-2600-ms-pacman?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-up-and-down)](https://paperswithcode.com/sota/atari-games-on-atari-2600-up-and-down?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-assault)](https://paperswithcode.com/sota/atari-games-on-atari-2600-assault?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-battle-zone)](https://paperswithcode.com/sota/atari-games-on-atari-2600-battle-zone?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-kangaroo)](https://paperswithcode.com/sota/atari-games-on-atari-2600-kangaroo?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-alien)](https://paperswithcode.com/sota/atari-games-on-atari-2600-alien?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-amidar)](https://paperswithcode.com/sota/atari-games-on-atari-2600-amidar?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-beam-rider)](https://paperswithcode.com/sota/atari-games-on-atari-2600-beam-rider?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-crazy-climber)](https://paperswithcode.com/sota/atari-games-on-atari-2600-crazy-climber?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-asterix)](https://paperswithcode.com/sota/atari-games-on-atari-2600-asterix?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-pong)](https://paperswithcode.com/sota/atari-games-on-atari-2600-pong?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-freeway)](https://paperswithcode.com/sota/atari-games-on-atari-2600-freeway?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-frostbite)](https://paperswithcode.com/sota/atari-games-on-atari-2600-frostbite?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-qbert)](https://paperswithcode.com/sota/atari-games-on-atari-2600-qbert?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-space-invaders)](https://paperswithcode.com/sota/atari-games-on-atari-2600-space-invaders?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-seaquest)](https://paperswithcode.com/sota/atari-games-on-atari-2600-seaquest?p=soft-actor-critic-for-discrete-action)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/soft-actor-critic-for-discrete-action/atari-games-on-atari-2600-breakout)](https://paperswithcode.com/sota/atari-games-on-atari-2600-breakout?p=soft-actor-critic-for-discrete-action)`

Soft Actor-Critic for Discrete Action Settings

16 Oct 2019 · Petros Christodoulou ·

Soft Actor-Critic is a state-of-the-art reinforcement learning algorithm for continuous action settings that is not applicable to discrete action settings. Many important settings involve discrete actions, however, and so here we derive an alternative version of the Soft Actor-Critic algorithm that is applicable to discrete action settings. We then show that, even without any hyperparameter tuning, it is competitive with the tuned model-free state-of-the-art on a selection of games from the Atari suite.

PDF Abstract

Code

Add Remove Mark official

p-christ/Deep-Reinforcement-Learnin… official

5,416

ku2482/sac-discrete.pytorch

246

ac-93/soft-actor-critic

ku2482/rljax

BY571/SAC_discrete

See all 12 implementations

Tasks

Add Remove

Atari Games

reinforcement-learning

Reinforcement Learning (RL)

Datasets

Arcade Learning Environment

Results from the Paper

Edit

Ranked #42 on Atari Games on Atari 2600 Road Runner

Get a GitHub badge

Task	Dataset	Model	Metric Name	Metric Value	Global Rank	Benchmark
Atari Games	Atari 2600 Alien	SAC	Score	216.9	# 47	Compare
Atari Games	Atari 2600 Amidar	SAC	Score	7.9	# 48	Compare
Atari Games	Atari 2600 Assault	SAC	Score	350	# 45	Compare
Atari Games	Atari 2600 Asterix	SAC	Score	272	# 49	Compare
Atari Games	Atari 2600 Battle Zone	SAC	Score	4386.7	# 46	Compare
Atari Games	Atari 2600 Beam Rider	SAC	Score	432.1	# 48	Compare
Atari Games	Atari 2600 Breakout	SAC	Score	0.7	# 58	Compare
Atari Games	Atari 2600 Crazy Climber	SAC	Score	3668.7	# 48	Compare
Atari Games	Atari 2600 Enduro	SAC	Score	0.8	# 44	Compare
Atari Games	Atari 2600 Freeway	SAC	Score	4.4	# 51	Compare
Atari Games	Atari 2600 Frostbite	SAC	Score	59.4	# 53	Compare
Atari Games	Atari 2600 James Bond	SAC	Score	68.3	# 44	Compare
Atari Games	Atari 2600 Kangaroo	SAC	Score	29.3	# 46	Compare
Atari Games	Atari 2600 Ms. Pacman	SAC	Score	690.9	# 44	Compare
Atari Games	Atari 2600 Pong	SAC	Score	-20.98	# 50	Compare
Atari Games	Atari 2600 Q*Bert	SAC	Score	280.5	# 53	Compare
Atari Games	Atari 2600 Road Runner	SAC	Score	305.3	# 42	Compare
Atari Games	Atari 2600 Seaquest	SAC	Score	211.6	# 55	Compare
Atari Games	Atari 2600 Space Invaders	SAC	Score	160.8	# 53	Compare
Atari Games	Atari 2600 Up and Down	SAC	Score	250.7	# 44	Compare

Methods

Add Remove

No methods listed for this paper. Add relevant methods here

Edit Social Preview

Soft Actor-Critic for Discrete Action Settings

Code Edit Add Remove Mark official

Tasks Edit Add Remove

Datasets Edit

Results from the Paper Edit

Methods Edit Add Remove

Code

Add Remove Mark official

Tasks

Add Remove

Datasets

Results from the Paper

Edit

Methods

Add Remove