Search Results for author:
Found 2 papers, 1 papers with code
Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models
We show that the heavy-tailed class imbalance found in language modeling tasks leads to difficulties in the optimization dynamics.
UNSAT Solver Synthesis via Monte Carlo Forest Search
We introduce Monte Carlo Forest Search (MCFS), a class of reinforcement learning (RL) algorithms for learning policies in {tree MDPs}, for which policy execution involves traversing an exponential-sized tree.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
