Search Results for author:
Found 4 papers, 1 papers with code
Grokking Group Multiplication with Cosets
We use the group Fourier transform over the symmetric group $S_n$ to reverse engineer a 1-layer feedforward network that has "grokked" the multiplication of $S_5$ and $S_6$.
YaRN: Efficient Context Window Extension of Large Language Models
Rotary Position Embeddings (RoPE) have been shown to effectively encode positional information in transformer-based language models.
An ML approach to resolution of singularities
The solution set of a system of polynomial equations typically contains ill-behaved, singular points.
Stay on topic with Classifier-Free Guidance
Classifier-Free Guidance (CFG) has recently emerged in text-to-image generation as a lightweight technique to encourage prompt-adherence in generations.
Ranked #1 on
Text Generation
on SciQ
