Search Results for author:
Found 1 papers, 0 papers with code
On Proximal Policy Optimization's Heavy-tailed Gradients
In this paper, we present a detailed empirical study to characterize the heavy-tailed nature of the gradients of the PPO surrogate reward function.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
