Search Results for author:
Found 2 papers, 2 papers with code
Position Interpolation Improves ALiBi Extrapolation
Linear position interpolation helps pre-trained models using rotary position embeddings (RoPE) to extrapolate to longer sequence lengths.
BTLM-3B-8K: 7B Parameter Performance in a 3B Parameter Model
BTLM-3B-8K is available under an Apache 2. 0 license on Hugging Face: https://huggingface. co/cerebras/btlm-3b-8k-base.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
